-- Logs begin at Fri 2021-08-27 02:49:42 UTC, end at Fri 2021-08-27 03:56:02 UTC. -- Aug 27 03:20:50.258294 dv-cinder-804735-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:20:50.266110 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:20:50 2021] *** Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: nodename: dv-cinder-804735-2-iscsi Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: machine: x86_64 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: clock source: unix Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: pcre jit disabled Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: detected number of CPU cores: 4 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: current working directory: / Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: your processes number limit is 47680 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: your memory page size is 4096 bytes Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: detected max file descriptor number: 2048 Aug 27 03:20:50.269253 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: lock engine: pthread robust mutexes Aug 27 03:20:50.270117 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: thunder lock: enabled Aug 27 03:20:50.270117 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:20:50.270117 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:20:50.315582 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: Python main interpreter initialized at 0x55d5642949c0 Aug 27 03:20:50.315582 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: python threads support enabled Aug 27 03:20:50.315582 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: your server socket listen backlog is limited to 100 connections Aug 27 03:20:50.315582 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:20:50.315991 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:20:50.315991 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: *** Operational MODE: preforking *** Aug 27 03:20:50.316257 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:20:50.316257 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: spawned uWSGI master process (pid: 93163) Aug 27 03:20:50.316446 dv-cinder-804735-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:20:50.319382 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: spawned uWSGI worker 1 (pid: 93164, cores: 1) Aug 27 03:20:50.319382 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: spawned uWSGI worker 2 (pid: 93165, cores: 1) Aug 27 03:20:50.319382 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:20:51.946822 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:20:51.946822 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: from cryptography.utils import int_from_bytes Aug 27 03:20:51.947605 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:20:51.947605 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: from cryptography.utils import int_from_bytes Aug 27 03:20:51.948057 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:20:51.948057 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: from cryptography.utils import int_from_bytes Aug 27 03:20:51.948200 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:20:51.948200 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: from cryptography.utils import int_from_bytes Aug 27 03:20:54.605897 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:20:54.606477 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:20:54.606571 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:20:54.606659 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:20:54.606989 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:20:54.607072 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:20:54.607151 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:20:54.607334 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:20:54.607581 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.607712 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:20:54.607871 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.607962 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:20:54.608216 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.608346 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.608512 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.608605 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.608857 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609007 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609133 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609229 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609473 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609605 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609791 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.609924 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610109 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610240 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610325 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610440 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610657 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610788 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.610977 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-2-iscsi {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611117 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611290 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611462 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611594 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611762 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-2-iscsi {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.611933 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612063 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612210 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612368 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612502 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612594 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612817 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.612925 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.613114 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.613223 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.613426 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.613602 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.613721 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.614870 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.614985 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615071 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615140 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615205 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615271 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615385 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615484 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615555 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615622 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615687 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.615753 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616004 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616180 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616270 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616352 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616487 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616580 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616763 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.616877 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617153 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-2-iscsi {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617239 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617464 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617549 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-2-iscsi {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617769 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.617855 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618077 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618165 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618429 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618513 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618775 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.618946 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619075 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619225 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619439 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619609 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619786 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.619881 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620049 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620165 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620368 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620467 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620682 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620778 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.620995 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621080 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621304 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621403 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621600 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621691 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621899 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.621989 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622199 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622389 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622500 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622627 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622797 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.622883 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623097 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623191 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623343 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623454 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623650 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623736 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.623951 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624045 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624265 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624350 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624575 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624687 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624823 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.624918 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625067 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625160 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625353 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625452 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625667 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625751 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.625965 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626047 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626267 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626361 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626567 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626651 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626864 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.626955 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627161 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627246 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627482 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627570 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627783 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.627867 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628079 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628164 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628377 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628467 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628691 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.628776 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629002 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629086 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629303 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629387 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629607 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629697 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.629919 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630004 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630224 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630308 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630526 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630611 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630830 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.630914 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631159 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631489 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631591 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631810 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.631905 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632107 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632201 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632408 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632539 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632707 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.632791 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633005 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633087 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633303 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633395 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633618 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633702 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.633914 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634035 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634161 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634254 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634451 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634548 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634811 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.634929 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.635142 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.635333 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.635613 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.635740 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.635825 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636043 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636138 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636347 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636430 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636640 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636725 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.636941 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637033 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637340 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637543 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637626 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637844 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.637936 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638142 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638225 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638439 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638522 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638741 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.638835 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639039 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639123 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639340 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639479 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639675 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639767 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.639989 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640081 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640286 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640370 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640584 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640676 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640882 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.640974 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641179 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641276 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641493 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641592 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641794 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.641877 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642090 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642174 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642400 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642497 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642701 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642792 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.642997 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643077 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643306 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643435 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643630 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643725 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.643929 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644012 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644238 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644331 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644533 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644622 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644874 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.644964 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645139 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645231 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645435 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645527 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645732 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.645816 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646027 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646117 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646323 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646407 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646619 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646709 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.646916 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647001 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647211 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647295 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647531 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647628 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647826 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.647910 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648136 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648229 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648450 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648631 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648752 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.648835 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649048 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649156 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649352 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649450 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649660 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649745 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:20:54.649988 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.650078 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.650331 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.650531 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.650696 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.650789 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651011 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651146 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651384 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651488 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651691 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.651784 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652007 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652091 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652317 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652410 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652625 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652715 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.652944 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653035 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653249 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653334 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653555 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653646 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653862 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.653953 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654175 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654259 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654485 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654568 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654808 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.654919 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655120 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655206 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655453 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655542 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655767 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.655861 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656074 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656160 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656386 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656471 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656709 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.656804 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657024 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657115 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657328 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657411 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657663 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657759 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.657997 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658080 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658303 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658387 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658622 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658719 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.658926 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659009 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659245 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659337 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659578 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659674 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659884 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.659967 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660189 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660272 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660498 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660581 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660804 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.660889 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661105 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661197 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661431 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661516 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661738 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.661822 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662044 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662197 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662374 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662468 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662645 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662729 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.662944 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663031 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663246 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663407 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663568 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663659 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663882 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.663974 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664197 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664282 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664497 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664586 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664821 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.664917 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665118 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665205 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665420 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665514 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665722 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.665815 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666081 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666228 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666408 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666496 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666702 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.666844 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667000 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667087 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667317 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667429 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667644 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667740 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.667944 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668030 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668259 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668352 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668559 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668644 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668855 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.668939 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669162 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669247 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669464 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669548 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669764 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.669847 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670068 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670164 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670381 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670465 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670683 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670774 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.670982 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671065 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671308 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671415 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671654 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671749 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.671952 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672041 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672268 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672352 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672585 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672676 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672891 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.672983 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673187 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673277 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673491 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673583 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673788 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.673882 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674086 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674184 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674383 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674467 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674686 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674781 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.674982 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675073 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675279 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675415 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675605 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675699 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675902 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.675987 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676201 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676286 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676513 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676606 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676812 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.676896 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677106 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677190 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677400 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677485 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677694 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.677778 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678024 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678116 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678318 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678403 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678652 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678744 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.678977 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679068 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679286 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679419 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679630 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679715 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.679932 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680016 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680336 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680545 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680628 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680847 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.680940 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.681462 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.681549 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.681793 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.681928 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682226 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682327 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682564 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682665 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682882 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.682968 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683191 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683291 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683536 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683628 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683840 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.683926 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684153 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684253 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684450 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684540 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684759 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.684850 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685088 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685187 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685415 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685505 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685724 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.685814 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686038 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686123 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686342 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686425 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686650 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686754 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.686951 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687036 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687253 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687336 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687582 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687665 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687884 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.687969 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688195 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688280 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688496 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688587 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688806 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.688891 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689112 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689197 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689429 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689512 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689730 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.689815 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690039 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690122 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690334 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690425 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690638 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690722 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.690959 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691042 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691284 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691430 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691614 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691699 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.691918 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692001 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692232 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692324 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692535 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692625 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692839 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.692934 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693144 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693237 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693441 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693525 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693738 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.693829 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694041 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694134 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694355 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694441 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694661 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694754 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.694965 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695050 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695261 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695362 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695595 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695726 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695900 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.695993 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696195 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696279 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696491 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696575 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696792 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.696880 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697105 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697189 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697460 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697546 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697780 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.697922 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698091 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698178 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698387 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698471 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698687 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.698778 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699003 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699088 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699305 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699430 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699631 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699717 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.699928 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700013 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700223 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700385 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700557 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700650 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700862 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.700955 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701161 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701257 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701471 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701557 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701787 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.701871 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702088 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702181 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702393 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702477 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702696 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702780 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.702999 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703099 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703311 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703418 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703645 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703770 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.703949 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704047 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704252 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704336 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704555 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704637 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704858 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.704943 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705161 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705245 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705476 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705567 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705780 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.705864 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706082 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706165 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706385 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706476 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706682 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706811 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.706986 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.707069 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.707304 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.707449 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708049 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708181 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708269 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708348 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708520 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708614 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708835 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.708919 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709150 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709235 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709461 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709554 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709782 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.709866 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710103 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710187 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710409 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710495 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710708 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.710791 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711011 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711094 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711313 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711431 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711638 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711732 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.711943 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712026 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712327 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712539 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712622 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.712879 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713016 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713164 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713281 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713465 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713663 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713827 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.713968 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714135 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714280 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714440 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714585 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714753 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.714897 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715056 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715203 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715401 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715536 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715683 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.715838 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716004 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716156 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716310 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716461 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716610 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716806 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.716928 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717110 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717206 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717412 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717499 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717752 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.717836 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718054 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718148 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718388 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718474 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718714 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.718798 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719046 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719130 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719367 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719466 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719676 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719769 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.719977 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720062 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720279 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720365 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720580 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720673 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720877 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.720962 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721178 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721271 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721477 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721562 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721772 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.721857 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722073 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722157 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722374 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722458 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722674 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722759 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.722972 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723099 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723280 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723396 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723617 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723708 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.723922 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724005 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724223 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724384 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724523 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724616 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724820 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.724904 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725119 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725216 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725419 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725505 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725717 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.725801 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726015 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726111 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726308 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726391 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726606 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726690 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.726910 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727031 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727208 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727301 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727531 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727617 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727832 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.727918 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728132 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728215 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728432 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728602 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728812 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.728898 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729130 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729332 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729437 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729642 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729738 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.729953 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730038 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730257 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730343 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730557 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730663 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730863 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.730948 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731183 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731268 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731516 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731603 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731815 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.731901 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732119 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732206 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732418 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732503 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732715 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.732799 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733012 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733095 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733316 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733409 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733610 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.733694 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734153 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734239 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734239 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734372 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734482 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734567 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734775 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.734859 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735092 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735184 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735415 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735504 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735715 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.735812 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736012 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736140 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736308 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736392 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736647 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736741 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.736946 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737029 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737300 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737392 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737602 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737696 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737912 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.737998 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738226 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738310 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738534 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738628 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738841 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.738925 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739151 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739236 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739475 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739575 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739791 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.739876 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740096 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740179 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740405 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740491 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740707 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.740790 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741005 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741090 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741320 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741406 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741627 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741720 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.741934 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742022 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742252 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742345 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742569 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742661 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742888 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.742972 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743187 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743314 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743518 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743604 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743825 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.743924 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744304 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744403 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744484 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744561 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744778 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.744874 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745087 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745176 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745397 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745489 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745706 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.745804 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746016 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746102 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746323 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746424 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746626 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746723 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.746933 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747017 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747236 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747320 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747563 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747666 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747882 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.747968 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748187 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748272 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748492 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748578 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748798 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.748883 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749099 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749183 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749403 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749495 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749703 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.749833 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750134 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750221 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750441 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750533 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750749 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.750833 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751048 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751132 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751400 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751533 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751684 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751770 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.751995 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.752090 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.752304 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.752389 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.752604 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.752688 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753012 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753173 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753319 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753413 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753625 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753709 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.753931 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754023 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754233 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754327 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754532 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754623 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754837 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.754931 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755156 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755240 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755485 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755585 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755788 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.755882 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756090 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756181 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756407 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756503 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756705 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.756790 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757023 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757108 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757435 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757520 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757745 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.757832 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758048 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758131 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758456 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758550 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758767 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.758858 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759072 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759155 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759412 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759498 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759755 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.759854 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760074 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760221 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760378 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760533 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760689 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760848 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.760996 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761159 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761317 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761486 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761637 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761813 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.761946 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762125 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762253 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762440 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762534 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762745 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.762858 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763066 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763178 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763408 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763498 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763724 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.763819 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764047 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764218 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764460 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764544 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764783 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.764884 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765090 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765185 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765408 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765495 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765732 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.765825 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766035 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766128 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766337 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766430 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766639 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766723 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.766940 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767026 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767240 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767340 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767573 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767661 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767877 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.767961 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768180 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768278 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768488 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768574 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768794 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.768880 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769092 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769185 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769390 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769475 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769698 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769782 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.769993 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770080 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770311 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770396 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770623 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770708 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.770938 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771025 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771328 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771569 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771654 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771879 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.771965 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772182 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772268 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772483 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772568 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772784 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.772878 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773084 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773170 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773412 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773506 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773714 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.773812 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774033 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774119 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774357 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774451 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774666 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774752 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.774975 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.775059 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.775307 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.775602 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.775774 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.775912 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776067 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776183 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776389 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776512 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776695 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776790 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.776997 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777083 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777305 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777407 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777609 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777706 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777907 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.777994 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778209 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778298 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778514 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778598 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778820 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.778908 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779120 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779205 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779443 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779533 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779747 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.779834 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780069 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780157 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780371 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780457 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780690 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780775 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.780993 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781079 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781293 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781377 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781591 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781676 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781886 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.781979 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782222 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782307 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782520 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782614 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782849 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.782935 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783159 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783244 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783498 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783613 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783809 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.783905 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784117 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784210 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784430 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784526 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784743 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.784847 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785051 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785136 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785356 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785451 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785664 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785758 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.785972 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786057 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786278 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786365 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786587 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786690 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786890 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.786985 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.787203 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.787296 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.787535 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.787647 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.787853 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.788098 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.788374 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.788461 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.788707 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.788794 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789021 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789107 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789329 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789422 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789639 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789724 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.789944 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790039 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790252 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790336 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790557 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790642 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790863 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.790957 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791198 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791299 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791543 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791631 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791872 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.791986 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792180 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792274 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792503 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792593 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792836 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.792924 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793146 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793232 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793455 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793540 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793761 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.793862 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794070 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794166 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794408 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794506 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794711 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.794797 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795015 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795108 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795323 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795461 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795657 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795754 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.795964 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796048 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796268 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796361 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796572 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796664 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796878 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.796970 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797182 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797276 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797488 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797580 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797793 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.797893 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798101 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798198 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798402 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798495 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798727 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.798814 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799043 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799129 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799371 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799460 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799688 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799888 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.799999 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.800092 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.800313 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.800516 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.800828 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.800922 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801141 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801225 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801466 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801552 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801788 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.801909 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802098 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802184 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802410 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802494 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802725 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.802819 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803030 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803115 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803333 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803440 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803660 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803752 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.803964 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804102 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804269 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804353 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804575 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804669 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804883 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.804968 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805186 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805284 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805486 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805571 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805794 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.805891 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.806421 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.806697 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807005 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807115 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807383 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807551 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807694 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.807864 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808020 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808122 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808341 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808439 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808647 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808743 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.808953 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809045 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809265 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809351 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809569 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809663 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809876 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.809970 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810179 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810264 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810482 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810576 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810783 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.810872 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811087 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811172 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811413 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811521 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811720 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.811807 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812022 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812107 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812321 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812407 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812620 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812704 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.812936 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813021 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813240 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813325 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813539 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813623 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813838 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.813922 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.814147 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.814896 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815206 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815292 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815548 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815634 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815861 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.815954 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816173 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816259 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816477 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816563 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816790 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.816875 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817098 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817201 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817406 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817499 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817710 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.817795 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818015 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818098 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818327 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818464 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818626 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818712 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.818933 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819020 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819236 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819331 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819575 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819664 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819886 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.819972 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820193 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820290 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820502 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820594 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820812 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.820898 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821118 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821211 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821453 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821546 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821765 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.821988 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.822331 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.822430 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.822664 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.822777 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.822998 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.823284 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.823403 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.823653 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.823740 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.823961 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824046 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824267 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824396 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824569 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824655 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824887 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.824972 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825194 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825291 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825502 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825587 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825809 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.825894 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826114 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826199 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826419 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826512 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826723 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.826807 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827028 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827165 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827333 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827452 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827660 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827745 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.827965 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828051 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828269 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828355 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828606 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828703 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.828920 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829011 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829233 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829325 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829545 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829638 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829852 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.829938 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830159 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830242 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830473 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830572 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830769 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.830853 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831073 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831158 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831400 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831501 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831728 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.831815 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832037 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832120 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832337 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832423 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832747 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.832832 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833053 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833137 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833364 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833450 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833679 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833764 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.833984 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834075 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834300 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834386 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834615 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834708 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.834923 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835018 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835236 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835393 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835569 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835655 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835893 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.835991 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836225 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836310 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836547 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836631 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836863 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.836979 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837164 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837250 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837464 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837548 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837767 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.837854 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838162 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838256 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838491 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838612 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838806 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.838959 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839129 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839282 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839461 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839621 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839782 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.839944 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840090 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840257 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840407 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840579 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840725 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.840899 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841035 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841212 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841343 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841522 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841670 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841850 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.841976 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842161 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842283 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842470 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842591 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842778 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.842896 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843085 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843195 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843424 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843515 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843732 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.843821 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844054 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844141 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844376 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844472 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844681 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.844771 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845002 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845097 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845316 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845441 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845628 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845715 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.845936 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846030 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846243 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846340 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846556 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846642 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846860 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.846954 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847162 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847269 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847494 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847584 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847800 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.847887 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848111 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848195 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848428 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848511 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848749 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.848877 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849067 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849167 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849385 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849481 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849703 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.849798 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850027 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850121 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850340 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850453 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850680 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850784 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.850921 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:20:54.851016 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:20:54.851231 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:20:54.873567 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_db.sqlalchemy.engines [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:54.874629 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_db.sqlalchemy.engines [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:54.952223 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.context [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4467ff74-47c5-40ba-9d11-c803109ba365(cell1) {{(pid=93165) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:20:54.952694 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.context [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4467ff74-47c5-40ba-9d11-c803109ba365(cell1) {{(pid=93164) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:20:54.956883 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:20:54.957079 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_concurrency.lockutils [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:20:54.958459 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:20:54.958656 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_concurrency.lockutils [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:20:54.959258 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:20:54.959457 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_concurrency.lockutils [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:20:54.961200 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:20:54.961969 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_concurrency.lockutils [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:20:54.973625 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_db.sqlalchemy.engines [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:54.976642 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_db.sqlalchemy.engines [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:54.979168 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_db.sqlalchemy.engines [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:54.983543 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_db.sqlalchemy.engines [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:55.336908 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_db.sqlalchemy.engines [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:55.340948 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG oslo_db.sqlalchemy.engines [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:20:55.679662 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: WARNING keystonemiddleware.auth_token [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:20:55.686775 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: WARNING keystonemiddleware.auth_token [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:20:55.687132 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: WARNING keystonemiddleware.auth_token [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:20:55.693611 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: WARNING keystonemiddleware.auth_token [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:20:56.028832 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: WARNING keystonemiddleware.auth_token [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:20:56.034041 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: WARNING keystonemiddleware.auth_token [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:20:56.039191 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5642949c0 pid: 93165 (default app) Aug 27 03:20:56.041439 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:56.042605 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001807 Aug 27 03:20:56.043012 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 789 bytes} [Fri Aug 27 03:20:56 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:56.045101 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: WARNING keystonemiddleware.auth_token [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:20:56.050423 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: WARNING keystonemiddleware.auth_token [None req-43a96322-1346-4a8b-a48b-f0c1eb0288cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:20:56.055784 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5642949c0 pid: 93164 (default app) Aug 27 03:22:16.688497 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:16.689604 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 27 03:22:16.690069 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:17.122648 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-6272280c-9b26-414f-a676-11c21784299d admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:17.152697 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-6272280c-9b26-414f-a676-11c21784299d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453573 Aug 27 03:22:17.153390 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Aug 27 03:22:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:19.399584 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:19.400581 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-0348e4c0-4dcd-4c7c-b842-f758bf7d6f5e None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 27 03:22:19.400980 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:19.461450 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-36874166-4571-4989-802b-3dfe8d3b6dcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:19.479579 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:22:19.479579 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:22:19.510042 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-36874166-4571-4989-802b-3dfe8d3b6dcd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102368 Aug 27 03:22:19.510858 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:22:19.736418 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-dedcc901-ecba-474a-953d-4154822755cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:19.738932 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:22:19.738932 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: warnings.warn(msg) Aug 27 03:22:19.787519 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-dedcc901-ecba-474a-953d-4154822755cd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267752 Aug 27 03:22:19.788479 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Aug 27 03:22:19 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:21.990290 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-36874166-4571-4989-802b-3dfe8d3b6dcd admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:21.991579 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-36874166-4571-4989-802b-3dfe8d3b6dcd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 27 03:22:21.992177 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:22.105919 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-0b63a27b-1ef3-4fec-a015-43b8fb903da1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "id": "d1", "swap": 0}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:22.126383 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:22:22.126383 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: warnings.warn(msg) Aug 27 03:22:22.150349 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-0b63a27b-1ef3-4fec-a015-43b8fb903da1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151419 Aug 27 03:22:22.151826 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:22.164332 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-8fed60ba-1eb8-4eaa-aba8-5f894dc88cbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:22.165901 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:22:22.165901 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:22:22.203267 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-8fed60ba-1eb8-4eaa-aba8-5f894dc88cbd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042740 Aug 27 03:22:22.204563 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Aug 27 03:22:22 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:24.506962 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-0b63a27b-1ef3-4fec-a015-43b8fb903da1 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:24.508278 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-0b63a27b-1ef3-4fec-a015-43b8fb903da1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Aug 27 03:22:24.509233 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:24.573667 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-36981f06-b4ec-47f9-8045-a54d5d1bdd73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:24.594890 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-36981f06-b4ec-47f9-8045-a54d5d1bdd73 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078964 Aug 27 03:22:24.599515 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:24.609086 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-e278ac58-a524-4040-8b02-88b270adb6d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:24.633436 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-e278ac58-a524-4040-8b02-88b270adb6d2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028384 Aug 27 03:22:24.634023 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Aug 27 03:22:24 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:26.941381 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-36981f06-b4ec-47f9-8045-a54d5d1bdd73 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:26.942415 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-36981f06-b4ec-47f9-8045-a54d5d1bdd73 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 27 03:22:26.943009 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:27.002244 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-4ee492d5-cda3-4a02-a1b8-b8902640b63d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "swap": 0, "id": "d3", "name": "ds2G"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:27.019850 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-4ee492d5-cda3-4a02-a1b8-b8902640b63d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069903 Aug 27 03:22:27.020401 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:27.033136 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-d65b422d-1772-4f36-8efb-965f8d81d0f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:27.056588 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-d65b422d-1772-4f36-8efb-965f8d81d0f8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027106 Aug 27 03:22:27.057158 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Aug 27 03:22:27 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:29.242544 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-4ee492d5-cda3-4a02-a1b8-b8902640b63d admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:29.243672 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-4ee492d5-cda3-4a02-a1b8-b8902640b63d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 27 03:22:29.244075 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:29.303933 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:29.325933 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074934 Aug 27 03:22:29.327031 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:29.339415 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-e51acd0b-faaf-42f1-b434-52310cf599d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:29.364266 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-e51acd0b-faaf-42f1-b434-52310cf599d7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028546 Aug 27 03:22:29.365396 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Fri Aug 27 03:22:29 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:31.538264 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:31.539265 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 27 03:22:31.549673 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:31 2021] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:31.608913 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-1a1e7815-2c8f-4369-8ffa-4a0f74a1071d admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:31.632714 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-1a1e7815-2c8f-4369-8ffa-4a0f74a1071d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086646 Aug 27 03:22:31.633269 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Aug 27 03:22:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:33.842710 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:33.844135 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-c5a328fc-c07f-4877-8cf6-0447ad34d2b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 27 03:22:33.844739 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:33 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:33.911072 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-2c45e508-b9d0-43ed-a9a4-e89c1aeb320f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:33.934044 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-2c45e508-b9d0-43ed-a9a4-e89c1aeb320f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080897 Aug 27 03:22:33.934625 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:33 2021] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:33.947681 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-a623d8b4-e634-4a09-a1f0-2a964fa530a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:33.970945 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-a623d8b4-e634-4a09-a1f0-2a964fa530a9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027018 Aug 27 03:22:33.971544 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Aug 27 03:22:33 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:36.294938 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-2c45e508-b9d0-43ed-a9a4-e89c1aeb320f admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:36.296153 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-2c45e508-b9d0-43ed-a9a4-e89c1aeb320f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001830 Aug 27 03:22:36.296539 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:36.358766 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-9153d3cc-09ee-4cf1-95e8-82907c7956ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "id": "2", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:36.377279 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-9153d3cc-09ee-4cf1-95e8-82907c7956ef admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073941 Aug 27 03:22:36.377823 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:36.391912 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-9b5675e2-190e-4000-8d00-45be63284479 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:36.419522 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-9b5675e2-190e-4000-8d00-45be63284479 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032483 Aug 27 03:22:36.420211 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Aug 27 03:22:36 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:38.615026 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-9153d3cc-09ee-4cf1-95e8-82907c7956ef admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:38.616493 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-9153d3cc-09ee-4cf1-95e8-82907c7956ef admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 Aug 27 03:22:38.616902 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:38.678482 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-20c793c9-36bc-4740-a4e0-eec813da57ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:38.697685 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-20c793c9-36bc-4740-a4e0-eec813da57ff admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074343 Aug 27 03:22:38.698223 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:38 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:38.710294 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-b7c7e81d-3250-44e4-8268-f9e9784f58aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:38.733536 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-b7c7e81d-3250-44e4-8268-f9e9784f58aa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026873 Aug 27 03:22:38.734085 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Aug 27 03:22:38 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:40.958076 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-20c793c9-36bc-4740-a4e0-eec813da57ff admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:40.959121 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-20c793c9-36bc-4740-a4e0-eec813da57ff admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 27 03:22:40.959864 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:41.038553 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-e9d62f38-18a1-48b9-928a-dd05ae5a84f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:41.063544 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-e9d62f38-18a1-48b9-928a-dd05ae5a84f7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095670 Aug 27 03:22:41.064528 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:41.076542 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-063f69f9-06c5-49c5-8cef-9ca00d4ae885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:41.110108 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-063f69f9-06c5-49c5-8cef-9ca00d4ae885 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037215 Aug 27 03:22:41.111004 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Aug 27 03:22:41 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:43.356687 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-e9d62f38-18a1-48b9-928a-dd05ae5a84f7 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:43.358300 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-e9d62f38-18a1-48b9-928a-dd05ae5a84f7 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Aug 27 03:22:43.363693 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:22:43 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:43.427045 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:43.452971 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087581 Aug 27 03:22:43.453831 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Fri Aug 27 03:22:43 2021] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:43.477004 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-e23e0a78-c9d2-4f1e-81d1-8a58f854bcf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:43.501543 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-e23e0a78-c9d2-4f1e-81d1-8a58f854bcf7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038569 Aug 27 03:22:43.502111 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Fri Aug 27 03:22:43 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:22.992654 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:22.994170 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Aug 27 03:23:22.994772 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:23:22 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:23.060970 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-03730d3d-e6f2-4ca5-9939-17776898708e admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:23.078411 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-03730d3d-e6f2-4ca5-9939-17776898708e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073374 Aug 27 03:23:23.078954 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Aug 27 03:23:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:24.515760 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.517397 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-ea3b8363-96bc-451f-9a55-6120b9920c3c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002321 Aug 27 03:23:24.518039 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:24 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:24.737076 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-60710cb4-7bd4-491d-a372-f876d4d83550 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.744007 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.wsgi [None req-60710cb4-7bd4-491d-a372-f876d4d83550 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:23:24.744597 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-60710cb4-7bd4-491d-a372-f876d4d83550 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:24.745383 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-60710cb4-7bd4-491d-a372-f876d4d83550 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.083314 Aug 27 03:23:24.745921 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1191 bytes} [Fri Aug 27 03:23:24 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:24.761142 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-97108f4c-39b7-4369-892e-629b1a8fd933 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.788165 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-97108f4c-39b7-4369-892e-629b1a8fd933 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.033499 Aug 27 03:23:24.788681 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:24.799024 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-dc4e9983-a3db-43cd-a18e-c7226cdfb039 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.821869 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-dc4e9983-a3db-43cd-a18e-c7226cdfb039 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026338 Aug 27 03:23:24.822412 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:24.832460 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-157aa438-3c4f-46d2-97a5-3fe63ced1eeb admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.838928 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.wsgi [None req-157aa438-3c4f-46d2-97a5-3fe63ced1eeb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:23:24.839531 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-157aa438-3c4f-46d2-97a5-3fe63ced1eeb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:24.840328 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-157aa438-3c4f-46d2-97a5-3fe63ced1eeb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011424 Aug 27 03:23:24.840829 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1191 bytes} [Fri Aug 27 03:23:24 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:26.202971 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-dc4e9983-a3db-43cd-a18e-c7226cdfb039 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.204002 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-dc4e9983-a3db-43cd-a18e-c7226cdfb039 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 27 03:23:26.204360 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:26.401966 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-416e87c9-b3da-49c1-b12e-5309eedd4538 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.407389 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.wsgi [None req-416e87c9-b3da-49c1-b12e-5309eedd4538 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:23:26.408015 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-416e87c9-b3da-49c1-b12e-5309eedd4538 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:26.408787 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-416e87c9-b3da-49c1-b12e-5309eedd4538 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.067333 Aug 27 03:23:26.409254 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1191 bytes} [Fri Aug 27 03:23:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:26.419431 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-7685919a-2a47-4e4c-aa08-9b962a5ea93a admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.433244 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-7685919a-2a47-4e4c-aa08-9b962a5ea93a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017321 Aug 27 03:23:26.433755 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:26.445985 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-e82f73c3-0b90-421e-9f7c-800756c49b3d admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.465468 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-e82f73c3-0b90-421e-9f7c-800756c49b3d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024698 Aug 27 03:23:26.466190 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:26.480629 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-59c88945-b0ea-470a-8c7b-5e9cf2c05259 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.489580 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.wsgi [None req-59c88945-b0ea-470a-8c7b-5e9cf2c05259 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:23:26.490357 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-59c88945-b0ea-470a-8c7b-5e9cf2c05259 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:26.491667 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-59c88945-b0ea-470a-8c7b-5e9cf2c05259 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.016945 Aug 27 03:23:26.492173 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1191 bytes} [Fri Aug 27 03:23:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:27.837328 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-e82f73c3-0b90-421e-9f7c-800756c49b3d admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:27.838324 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-e82f73c3-0b90-421e-9f7c-800756c49b3d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 27 03:23:27.838720 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:28.038606 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-9b4e4cac-7f0e-4154-a319-1f5ceda7abb2 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.047207 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.wsgi [None req-9b4e4cac-7f0e-4154-a319-1f5ceda7abb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:23:28.047911 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-9b4e4cac-7f0e-4154-a319-1f5ceda7abb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:28.049087 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-9b4e4cac-7f0e-4154-a319-1f5ceda7abb2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.071701 Aug 27 03:23:28.049777 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:23:27 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:28.062669 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-625ad2fe-1149-40ec-97b5-a90640a16216 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.076760 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-625ad2fe-1149-40ec-97b5-a90640a16216 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.019114 Aug 27 03:23:28.077297 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:28.090792 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.113517 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027928 Aug 27 03:23:28.114259 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1211 bytes} [Fri Aug 27 03:23:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:28.125258 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-6b6ace8b-f1ec-4c4e-9b35-f4831a70554d admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.130934 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.wsgi [None req-6b6ace8b-f1ec-4c4e-9b35-f4831a70554d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:23:28.131536 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-6b6ace8b-f1ec-4c4e-9b35-f4831a70554d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:23:28.132724 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-6b6ace8b-f1ec-4c4e-9b35-f4831a70554d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.011040 Aug 27 03:23:28.133228 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:23:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:29.520077 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:29.521215 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 27 03:23:29.521802 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:29.723489 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-a51c6fe6-37a1-48d8-80ed-e1a616792608 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:29.743958 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-a51c6fe6-37a1-48d8-80ed-e1a616792608 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.082133 Aug 27 03:23:29.744500 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1236 bytes} [Fri Aug 27 03:23:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:23:31.095737 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:31.097149 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Aug 27 03:23:31.097668 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:31.310092 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-963dd752-1cc2-46d3-909b-b4ab46557e1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:31.332555 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-963dd752-1cc2-46d3-909b-b4ab46557e1e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.090343 Aug 27 03:23:31.333094 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1236 bytes} [Fri Aug 27 03:23:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:23:32.683918 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:32.684921 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 27 03:23:32.685316 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:32.897507 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-53205c9b-8e77-480a-a858-e8ec72463ed8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:32.927428 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-53205c9b-8e77-480a-a858-e8ec72463ed8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.094454 Aug 27 03:23:32.928379 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1236 bytes} [Fri Aug 27 03:23:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:23:34.277731 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:34.278753 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 27 03:23:34.279146 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:34.479519 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-85fba0b2-920d-43e1-9fd5-38b85bc28581 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:34.499843 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-85fba0b2-920d-43e1-9fd5-38b85bc28581 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.080952 Aug 27 03:23:34.500328 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1236 bytes} [Fri Aug 27 03:23:34 2021] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:23:35.877841 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:35.879634 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002440 Aug 27 03:23:35.880192 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:23:35 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:36.091496 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-64fbc0cf-d658-485d-877e-14bfed98bcfc admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:36.110798 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-64fbc0cf-d658-485d-877e-14bfed98bcfc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.093998 Aug 27 03:23:36.111326 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1203 bytes} [Fri Aug 27 03:23:36 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:21.603407 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.604331 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-32406ac9-7430-48bf-a3ec-f5b20bcfd076 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 27 03:24:21.604719 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:24:21.684494 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-eb9c1ca2-c0c3-4036-9266-4a530f646833 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.706594 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-eb9c1ca2-c0c3-4036-9266-4a530f646833 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.095253 Aug 27 03:24:21.707130 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:21.732469 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-dd424745-6b61-4cd7-9d16-b676e6d18f95 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.743015 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-dd424745-6b61-4cd7-9d16-b676e6d18f95 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016612 Aug 27 03:24:21.743603 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.755714 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-e169f189-1fba-4b60-b3b8-4d25852a5881 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.763401 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-e169f189-1fba-4b60-b3b8-4d25852a5881 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Aug 27 03:24:21.763930 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:21.778292 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-048a284b-aa47-4090-87fc-15847abc7d3a admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.790420 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-048a284b-aa47-4090-87fc-15847abc7d3a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017488 Aug 27 03:24:21.791221 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.807176 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.815163 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011663 Aug 27 03:24:21.815761 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Fri Aug 27 03:24:21 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:41.907911 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-8ea05d22-07c0-442d-9c2c-aa2e73de2479 tempest-verify_tempest_config-2111776750 tempest-verify_tempest_config-2111776750-project] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:41.910938 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-8ea05d22-07c0-442d-9c2c-aa2e73de2479 tempest-verify_tempest_config-2111776750 tempest-verify_tempest_config-2111776750-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120059 Aug 27 03:25:41.911567 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1134 bytes} [Fri Aug 27 03:25:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:27:18.038156 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:18.039196 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 27 03:27:18.039645 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 36/70] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:27:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:18.323317 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:18.324551 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:27:18.324551 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:27:18.326187 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:18.326635 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:18.327452 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:18.327872 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:18.363460 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-bd871531-0d35-46d6-9692-4f52cb6d8d54 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.177399 Aug 27 03:27:18.364063 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:27:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:27:19.720915 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:19.722513 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 27 03:27:19.723156 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 37/72] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:27:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:19.924465 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:19.925719 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:27:19.925719 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:27:19.927238 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:19.927764 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:19.928479 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:19.928900 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:19.953660 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-a7475c40-27ee-4231-9817-d82d4d3312aa admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.087422 Aug 27 03:27:19.954213 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 36/73] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:27:19 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:31.921493 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:31.922537 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 27 03:27:31.922930 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:27:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:32.129713 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:32.130895 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:27:32.130895 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:27:32.132447 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:32.132885 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:32.133673 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:32.134099 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:32.155515 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-219577b0-4565-4164-bd13-d4f4b97a3d9d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.088002 Aug 27 03:27:32.156074 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 37/75] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:27:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:33.550888 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: DEBUG nova.api.openstack.wsgi [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] Calling method '>' {{(pid=93165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:33.551939 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: INFO nova.api.openstack.requestlog [None req-48a656c7-2ffc-4896-8c78-eed185d6c882 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Aug 27 03:27:33.552332 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: [pid: 93165|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1075 bytes} [Fri Aug 27 03:27:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:33.755193 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG nova.api.openstack.wsgi [None req-ec34d327-0285-439a-8970-344989830dae admin admin] Calling method '>' {{(pid=93164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:33.756382 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:27:33.756382 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: warnings.warn(msg) Aug 27 03:27:33.757921 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-ec34d327-0285-439a-8970-344989830dae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:33.758354 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-ec34d327-0285-439a-8970-344989830dae admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:33.759155 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-ec34d327-0285-439a-8970-344989830dae admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:27:33.759587 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: DEBUG oslo_concurrency.lockutils [None req-ec34d327-0285-439a-8970-344989830dae admin admin] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:27:33.780267 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: INFO nova.api.openstack.requestlog [None req-ec34d327-0285-439a-8970-344989830dae admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.087312 Aug 27 03:27:33.780830 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: [pid: 93164|app: 0|req: 38/77] 10.222.0.58 () {60 vars in 1194 bytes} [Fri Aug 27 03:27:33 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:28:31.103465 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: Fri Aug 27 03:28:31 2021 - graceful shutdown triggered... Aug 27 03:28:31.103532 dv-cinder-804735-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 03:28:31.104593 dv-cinder-804735-2-iscsi devstack@n-api.service[93164]: Gracefully killing worker 1 (pid: 93164)... Aug 27 03:28:31.105201 dv-cinder-804735-2-iscsi devstack@n-api.service[93165]: Gracefully killing worker 2 (pid: 93165)... Aug 27 03:28:32.105844 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: worker 1 buried after 1 seconds Aug 27 03:28:32.105844 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: worker 2 buried after 1 seconds Aug 27 03:28:32.105844 dv-cinder-804735-2-iscsi devstack@n-api.service[93163]: goodbye to uWSGI. Aug 27 03:28:32.108435 dv-cinder-804735-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 27 03:28:32.109497 dv-cinder-804735-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 03:28:32.114029 dv-cinder-804735-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:28:32.125453 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:28:32.128154 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:28:32 2021] *** Aug 27 03:28:32.128317 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:28:32.128450 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:28:32.128570 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: nodename: dv-cinder-804735-2-iscsi Aug 27 03:28:32.128678 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: machine: x86_64 Aug 27 03:28:32.128797 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: clock source: unix Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: pcre jit disabled Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: detected number of CPU cores: 4 Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: current working directory: / Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: your processes number limit is 47680 Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: your memory page size is 4096 bytes Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: detected max file descriptor number: 2048 Aug 27 03:28:32.128972 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: lock engine: pthread robust mutexes Aug 27 03:28:32.129548 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: thunder lock: enabled Aug 27 03:28:32.129548 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:28:32.129548 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:28:32.174827 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: Python main interpreter initialized at 0x5563ce8889c0 Aug 27 03:28:32.174827 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: python threads support enabled Aug 27 03:28:32.174827 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: your server socket listen backlog is limited to 100 connections Aug 27 03:28:32.174827 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:28:32.175290 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:28:32.175290 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: *** Operational MODE: preforking *** Aug 27 03:28:32.175586 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:28:32.175586 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: spawned uWSGI master process (pid: 108315) Aug 27 03:28:32.175812 dv-cinder-804735-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:28:32.176916 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: spawned uWSGI worker 1 (pid: 108335, cores: 1) Aug 27 03:28:32.176916 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: spawned uWSGI worker 2 (pid: 108336, cores: 1) Aug 27 03:28:32.176916 dv-cinder-804735-2-iscsi devstack@n-api.service[108315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:28:33.960022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:28:33.960022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: from cryptography.utils import int_from_bytes Aug 27 03:28:33.960779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:28:33.960779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: from cryptography.utils import int_from_bytes Aug 27 03:28:34.002443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:28:34.002443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: from cryptography.utils import int_from_bytes Aug 27 03:28:34.003125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:28:34.003125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: from cryptography.utils import int_from_bytes Aug 27 03:28:36.434743 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:28:36.435301 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:28:36.435504 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:28:36.435864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:28:36.436141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:28:36.436531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.436850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.437142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.437456 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.437780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.438086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.438407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.438722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.439048 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.439304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.439649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.439972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-2-iscsi {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.440291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.440603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.440907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.441220 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.441521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.441839 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.442141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.442641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.443099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.443424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.443718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.444063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.444378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.444665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.444980 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.445285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.445605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.445911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.446364 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-2-iscsi {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.446680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.446984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.447292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.447741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.448050 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.448343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.448660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.448979 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.449288 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.449613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.449928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.450245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.450568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.450868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.451172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.451503 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.451819 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.452122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.452425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.452671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.452971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.453289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.453603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.453922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.454169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.454462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.454784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.455147 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.455530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.456082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.456537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.456852 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.457159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.457463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.457766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.458074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.458392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.458704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.459029 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.459408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.459729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.460148 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.460397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.460707 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.461042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.461359 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.461666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.462030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.462388 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.462856 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.463163 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.463604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.463926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.464369 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.464664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.464913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.465261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.465559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.465876 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.466291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.466639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.466971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.467241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.467670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.467982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.468287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.468590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.468892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.469191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.469495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.469796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.470094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.470411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.470730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.471031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.471332 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.471656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.471958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.472274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.472576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.472878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.473194 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.473497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.473797 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.474111 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.474413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.474714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.475030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.475401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.475709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.476024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.476325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.476626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.476925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.477225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.477553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.477942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.478242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.478594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.478819 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.479131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.479477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.479816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.480122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.480467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.480785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.481127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.481453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.481794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.482115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.482440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.482767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.483084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.483415 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.483727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.484052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.484357 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.484664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.484972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.485286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.485599 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.485923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.486236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.486575 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.486858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.487165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.487576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.487902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.488221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.488530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.488869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.489212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.489523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.489844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.490197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.490522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.490879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.491188 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.491535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.491852 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.492168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.492475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.492810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.493146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.493465 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.493921 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.494231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.494536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.494845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.495311 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.495663 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.495988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.496463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.496954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.497297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.497578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.497974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.498286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.498596 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.498907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.499209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.499535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.499880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.500180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.500505 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.500808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.501115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.501427 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.501730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.502045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.502343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.502666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.502977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.503286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.503641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.503759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:28:36.504203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:28:36.504302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.504302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.504479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:28:36.504573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.504746 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:28:36.504877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.505000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:28:36.505196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.505390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.505484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.505733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.505835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.506053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.506154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.506370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.506477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.506670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.506773 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.506977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.507076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.507283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.507410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.507610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.507704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.507910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.508011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.508203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.508330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.508503 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.508672 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.508891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-2-iscsi {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.509063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.509217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.509379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.509677 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.509779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.509978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.510078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.510282 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.510384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.510598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.510699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.510918 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.511018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.511225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.511325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.511609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.511763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.511927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.512080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.512249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.512410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.512563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.512692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.512876 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.512993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.513187 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.513297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.513496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.513643 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.513803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.513947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.514095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.514189 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.514410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.514519 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.514717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.514812 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.515034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.515177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-2-iscsi {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.515342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.515554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.515688 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.515820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.516027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.516125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.516365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.516529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.516672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.516840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.516987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.517149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.517324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.517469 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.517658 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.517792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.517972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.518099 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.518295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.518463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.518609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.518759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.518929 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.519077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.519228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.519396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.519535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.519674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.519829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.519931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.520114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.520243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.520428 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.520562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.520740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.520866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.521053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.521161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.521358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.521452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.521677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.521782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.521984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.522086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.522334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.522452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.522665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.522848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.523008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.523157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.523300 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.523500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.523647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.523792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.523949 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.524130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.524278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.524508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.524670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.524863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.525146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.525298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.525449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.525594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.525737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.525941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.526090 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.526243 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.526386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.526529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.526679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.526836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.526990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.527142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.527294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.527494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.527647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.527806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.527958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.528102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.528247 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.528418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.528661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.529024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.529271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.529382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.529471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.529563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.529663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.529765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.530007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.530101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.530194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.530329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.530433 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.530573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.530671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.530800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.530947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.531042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.531185 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.531283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.531519 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.531680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.531825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.532027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.532186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.532293 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.532391 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.532572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.532745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.532896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.533003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.533149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.533255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.533468 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.533566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.533778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.533884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.534081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.534187 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.534413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.534740 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.534898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.535053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.535217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.535322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.535587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.535712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.535984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.536232 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.536382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.536532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.536678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.536855 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.537009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.537162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.537309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.537457 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.537594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.537748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.537884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.538051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.538199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.538359 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.538507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.538664 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.539002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.539185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.539431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.539575 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.539732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.539882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.540018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.540180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.540497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.540658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.540858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.541010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.541212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.541373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.541541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.541672 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.541999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.542113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.542328 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.542573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.542701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.542899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.543021 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.543426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.543549 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.543715 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.543804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.543934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.544036 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.544291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.544392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.544610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.544703 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.544925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.545024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.545232 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.545339 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.545542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.545643 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.545847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.545939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.546153 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.546255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.546459 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.546611 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.546763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.546864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.547067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.547169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.547389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.547487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.547700 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.547792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.548002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.548098 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.548302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.548396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.548611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.548712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:28:36.548914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549116 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.549950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550427 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.550973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551629 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551721 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.551983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552126 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.552907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553334 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.553942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.554869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.555070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.555572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.555765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.555923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.556076 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.556377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.556670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.556764 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.556980 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557288 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557596 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.557898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558506 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558818 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.558955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.559913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560367 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.560885 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.561947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562105 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562688 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562828 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.562965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.563975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564110 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.564901 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.565047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.565191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.565347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.565540 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.565858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566588 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.566891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.567833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568136 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568357 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.568743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569659 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.569840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.570127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.570504 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.570692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.570816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.571032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.571161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.571493 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.571653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.571850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572399 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.572862 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573384 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.573804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574008 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574447 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.574968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.575138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.575281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.575485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.575719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.575827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.576971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577064 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577596 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.577914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578646 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578854 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.578963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.579163 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.579392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.579570 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.579811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580006 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580475 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580890 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.580980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581076 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.581891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582187 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582416 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.582820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583518 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.583965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584361 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584881 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.584974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585536 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585630 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.585971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.586183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.586285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.586505 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.586600 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.586815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.587018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.587250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.587589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.587763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.587932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588203 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588435 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.588919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589087 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589740 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.589854 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590349 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590775 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.590994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591685 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.591994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.592116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.592277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.592695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.592825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.592946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593057 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593175 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593699 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.593945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.594836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.595965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596279 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596598 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.596942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597238 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.597971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598118 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598555 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.598836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.599009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.599157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.599314 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.599512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.599661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.600032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.600280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.600602 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.600919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.601229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.601561 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.601877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.602186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.602517 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.603385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.603744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.603974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.604135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.604368 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.604518 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.604703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.604935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.605978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.606988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.607997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608425 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608580 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.608886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609828 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.609981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.610378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.610543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.610703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.610849 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.610991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.611226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.611400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.611595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.611769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.611921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.612919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.613157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.613306 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.613485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.613643 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.613948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614098 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614388 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.614853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.615935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.616882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617036 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617179 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617330 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.617928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.618087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.618298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.618449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.618732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.618891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.619174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.619460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.619618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.619769 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.619961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.620110 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.620353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.620609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.620767 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.620920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621072 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621380 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.621969 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622281 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.622879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.623143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.623292 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.623485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.623648 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.623800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624688 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624830 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.624988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625730 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.625884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626339 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.626935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627078 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627403 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.627870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.628951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629244 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629514 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.629965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.630123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.630417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.630601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.630843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631178 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631812 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.631977 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.632984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.633208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.633365 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.633543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.633693 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.633913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.634201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.634472 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.634620 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635331 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635565 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.635865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636600 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.636909 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.637984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638282 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.638959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.639255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.639503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.639654 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.639851 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.640224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.640445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.640445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.640965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.641219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.641219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.641639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.641785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.641956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642540 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642734 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.642904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.643917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.644391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.644541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.644541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.644913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645252 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.645958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646874 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.646874 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.647167 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.647312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.647514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.647702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.647860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648966 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.648966 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.649267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.649446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.649626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.649922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.650071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.650222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.650364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.650628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.650872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651280 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651461 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651604 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.651896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.652059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.652203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.652346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.652575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.652733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.653019 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.653177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.653710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.653896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.654119 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.654274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.654599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.654754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.654898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.655122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.655274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.655592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.655752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.655909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.656228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.656380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.656532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.656808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.656966 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.657152 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.657301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.657454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.657644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.657807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.658063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.658219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.658374 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.658639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.658800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.659982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.660215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.660363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.660513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.660680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.660934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.661131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.661310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.661553 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.661702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.661845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.662082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.662399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.662667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.662831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.663907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.664057 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.664240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.664399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.664751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.665192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.665346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.665491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.665491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.666648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.666648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.666648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.667100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.667252 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668419 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668575 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668730 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.668882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669466 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.669920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670526 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670677 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.670993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.671388 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.671560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.671560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.671961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.672707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673054 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.673975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.674119 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.674270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.674413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.674564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.674878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.675037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.675193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.675903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.676973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677118 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.677932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678076 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678536 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.678840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.679771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.680085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.680085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.680882 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.680882 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.681159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.681456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.681613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.681613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.681994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682594 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.682921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683553 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.683991 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.684144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.684287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.684431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.684583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.684747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685361 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.685969 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.686898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687409 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.687871 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.688870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689605 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.689894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.690998 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.691294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.691570 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.691720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.691863 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692025 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692445 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.692895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693506 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.693947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694735 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.694885 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.695226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.695512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.695664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.695817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.695971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696290 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.696968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.697112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.697352 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.697572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.697731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.697885 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.698990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.699166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.699325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.699524 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.699670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.699813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700119 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700566 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.700914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.701086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.701407 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.701731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.701895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.702927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703465 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.703923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.704169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.704321 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.704474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:28:36.704704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.704897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.705284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.705539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.705860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.706225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.706546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.706860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.707180 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.707539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.707866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.708181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.708497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.708816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.709132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.709447 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.709761 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.710078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.710396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.710726 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.711072 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.711434 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.711778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.712727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.715163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.716923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.717208 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.717390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.717720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.718041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.718353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.718683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.719003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.719653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.720013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.720340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.720775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.721004 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.721335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.721748 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.721979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.722296 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.722744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.722932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.723251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.723590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.723902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.724222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.724539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.724852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.725168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.725720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.725896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.726114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.726426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.726736 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.727051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.729000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.729347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.729688 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.730017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.730364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.730689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.731024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.731400 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.731696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.732017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.732340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.732657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.733028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.733345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.733661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.734052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.734313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.734645 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.734992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.735313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.735896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.736076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.736642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.736984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.737341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.737709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.738059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.738376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.738698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.739011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.739376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.739701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.740023 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.740341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.740657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.740973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.741290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.741587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.741902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.742218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.742542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.742853 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.743294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.744544 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.744820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.745156 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.745484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.746083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.746251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.746455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.746774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.747106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.747485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.747816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.748130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.748579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.748898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.749237 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.749563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.749883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.750377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.751734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.752024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.752379 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.752719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.753089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.753507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.753786 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.754128 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.754457 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.754801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.755092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.755440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.755785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.756259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.756445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.756737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.757070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.757386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.757718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.758046 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.758370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.758690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.759067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.759964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.759964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.760259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.760423 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.760631 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.760947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.761281 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.761607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.761912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.762247 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.762564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.762882 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.763201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.763713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.763901 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.764182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.764498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.764806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.765122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.765421 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.765735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.766175 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.766587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.766751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.766987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.767367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.767698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.768054 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.768384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:28:36.768626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:28:36.830224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_db.sqlalchemy.engines [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:36.892130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_db.sqlalchemy.engines [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:36.912214 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.context [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4467ff74-47c5-40ba-9d11-c803109ba365(cell1) {{(pid=108336) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:28:36.916519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:36.918070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:36.918884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:36.922542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:36.933701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_db.sqlalchemy.engines [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:36.934530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_db.sqlalchemy.engines [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:36.974947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.context [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4467ff74-47c5-40ba-9d11-c803109ba365(cell1) {{(pid=108335) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:28:36.979970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:36.981558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:36.982360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:36.986074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:36.997321 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_db.sqlalchemy.engines [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:37.002107 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_db.sqlalchemy.engines [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:37.195364 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_db.sqlalchemy.engines [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:37.278989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_db.sqlalchemy.engines [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:28:37.515591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: WARNING keystonemiddleware.auth_token [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:28:37.522369 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: WARNING keystonemiddleware.auth_token [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:28:37.612978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: WARNING keystonemiddleware.auth_token [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:28:37.619915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: WARNING keystonemiddleware.auth_token [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:28:37.875545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: WARNING keystonemiddleware.auth_token [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:28:37.881273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: WARNING keystonemiddleware.auth_token [None req-9df53b46-9cd7-49ef-ad5d-a32942638741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:28:37.887642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563ce8889c0 pid: 108336 (default app) Aug 27 03:28:37.987590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: WARNING keystonemiddleware.auth_token [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:28:37.993031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: WARNING keystonemiddleware.auth_token [None req-f042a7b3-9920-4147-9a24-f32d9419efbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:28:37.998925 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563ce8889c0 pid: 108335 (default app) Aug 27 03:29:10.808352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f6a0e2e1-5eee-4aad-884f-6dd57b63e642 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Action: 'create', calling method: .version_select at 0x7f6cfd993ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-150298742"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:13.067759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f6a0e2e1-5eee-4aad-884f-6dd57b63e642 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.031041 Aug 27 03:29:13.068768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Aug 27 03:29:10 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3034 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:29:13.333084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b489853c-2e32-4f52-b986-49311796e377 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd9e39d0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.948998 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b489853c-2e32-4f52-b986-49311796e377 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 200 len: 345 microversion: 2.1 time: 0.870680 Aug 27 03:29:13.958760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:13 2021] GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 345 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:13.963013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-88fbf254-0675-4b2d-b719-b6745ef22567 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Action: 'create', calling method: .version_select at 0x7f6cfd9b8820>, body: {"snapshot": {"volume_id": "7edfa4df-9f14-421e-9712-6cb2c4728620", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-735713131"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:14.299420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-88fbf254-0675-4b2d-b719-b6745ef22567 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.340833 Aug 27 03:29:14.301053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1162 bytes} [Fri Aug 27 03:29:13 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:14.312931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-151be50e-a462-4d6c-b822-eaef515fee08 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd8aa790>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.400043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-151be50e-a462-4d6c-b822-eaef515fee08 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 200 len: 286 microversion: 2.1 time: 0.091718 Aug 27 03:29:14.407704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:14 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:14.414037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5db85a73-f777-46dd-85aa-d69d550e6b4c tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd863ee0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.485900 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5db85a73-f777-46dd-85aa-d69d550e6b4c tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.076775 Aug 27 03:29:14.486532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1140 bytes} [Fri Aug 27 03:29:14 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:14.499197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1378b80c-fc23-4572-95af-ef4c31810565 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd8630d0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.539223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1378b80c-fc23-4572-95af-ef4c31810565 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 200 len: 286 microversion: 2.1 time: 0.044758 Aug 27 03:29:14.540618 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:14 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:14.827647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-04e83a41-969b-4cc8-ae30-923dccf8ef0b tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfd872670>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.955969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-04e83a41-969b-4cc8-ae30-923dccf8ef0b tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/eac05b33-0d63-4413-bc7e-d443be1d5aed" status: 200 len: 351 microversion: 2.1 time: 0.137619 Aug 27 03:29:14.956704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:14 2021] GET /compute/v2.1/os-volumes/eac05b33-0d63-4413-bc7e-d443be1d5aed => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:15.284597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1179881107", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "88322726-f5e5-4254-a3d7-3a1875e31491"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:15.504231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] validate_networks() for [('88322726-f5e5-4254-a3d7-3a1875e31491', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:29:15.568074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6ec4a52a-9030-4f00-9d98-48efdbd5b722 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd7fe040>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.695252 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6ec4a52a-9030-4f00-9d98-48efdbd5b722 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 200 len: 286 microversion: 2.1 time: 0.146999 Aug 27 03:29:15.696363 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:15 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:16.328741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-671137031", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3"}]}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:16.479389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] validate_networks() for [('a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3', None, None, None, None, None)] {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:29:17.304111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:17.304823 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:17.305363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:17.305970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:17.306569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:17.346558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.347387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.348482 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.353149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.425658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Getting quotas for project dba5a01bf20b47e4a67299b2f5aa032b. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:17.437173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Getting quotas for user b514a1dc3cc642f2b83ba52eb39b4420 and project dba5a01bf20b47e4a67299b2f5aa032b. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:17.465166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:29:17.468038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:29:17.706283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:17.706787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:17.707447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:17.709651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:17.709857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:17.721023 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5b03d252-fdd5-4b8d-92da-d22a9089b1f5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.561339 Aug 27 03:29:17.727701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 4/9] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:29:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:17.740603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.741409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.743292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:17.745728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:17.748697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2fcf4476-9bd2-48f0-ac46-61c20a4b2472 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfd779160>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.817526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2fcf4476-9bd2-48f0-ac46-61c20a4b2472 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 200 len: 287 microversion: 2.1 time: 0.073328 Aug 27 03:29:17.817995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:17 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:17.822857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5a23804c-cd9a-4bad-bb30-338f3ecd5552 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.823996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5a23804c-cd9a-4bad-bb30-338f3ecd5552 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:17.861436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:17.881455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for user b0959c5e5b1c49a9b5395f90360ce934 and project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:17.920565 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:29:17.925289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:29:18.113203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5a23804c-cd9a-4bad-bb30-338f3ecd5552 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:18.132242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5a23804c-cd9a-4bad-bb30-338f3ecd5552 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1215 microversion: 2.1 time: 0.310792 Aug 27 03:29:18.135913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 6/11] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:17 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:18.151808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-08588c6d-0cfc-4357-911f-b4b297c2f9bd tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc711940>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.156740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-83771520-8b0c-4226-a48d-11d25671972c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114280 Aug 27 03:29:18.158669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 6/12] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:29:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:18.170762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e712fb92-86e9-4e3a-aa65-2df3ce5171d8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.172147 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e712fb92-86e9-4e3a-aa65-2df3ce5171d8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:18.368718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-08588c6d-0cfc-4357-911f-b4b297c2f9bd tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 202 len: 0 microversion: 2.1 time: 0.228684 Aug 27 03:29:18.369557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1254 bytes} [Fri Aug 27 03:29:18 2021] DELETE /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:18.392655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e712fb92-86e9-4e3a-aa65-2df3ce5171d8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:18.400136 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-76ed7d7e-1a1b-418e-91ef-262b905dcf37 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc729a60>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.454762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e712fb92-86e9-4e3a-aa65-2df3ce5171d8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1217 microversion: 2.1 time: 0.289320 Aug 27 03:29:18.458872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 7/14] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:18 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:18.470666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-76ed7d7e-1a1b-418e-91ef-262b905dcf37 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 200 len: 286 microversion: 2.1 time: 0.096584 Aug 27 03:29:18.471569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:18 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:19.062903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a38eef2c-04e2-4f4f-ac25-559b5fd6f757 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfd83b8b0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.152460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e2a94a4a-1fb1-4320-9ac1-02aace8b1871 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.153417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e2a94a4a-1fb1-4320-9ac1-02aace8b1871 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:19.190010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a38eef2c-04e2-4f4f-ac25-559b5fd6f757 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ce9124aa-fa57-4804-9d88-07e383ffb9ae" status: 200 len: 350 microversion: 2.1 time: 0.133230 Aug 27 03:29:19.191729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:19 2021] GET /compute/v2.1/os-volumes/ce9124aa-fa57-4804-9d88-07e383ffb9ae => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:19.475551 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f45881ed-fbb7-4ae8-a6d0-544cac8d6688 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.476590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f45881ed-fbb7-4ae8-a6d0-544cac8d6688 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:19.986782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e2a94a4a-1fb1-4320-9ac1-02aace8b1871 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.001505 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e2a94a4a-1fb1-4320-9ac1-02aace8b1871 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1215 microversion: 2.1 time: 0.852907 Aug 27 03:29:20.002339 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 9/17] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:19 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1215 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:20.034557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-230ee21a-248c-4081-86e1-a812eb16aa70 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc7330d0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.072752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f45881ed-fbb7-4ae8-a6d0-544cac8d6688 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.080454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f45881ed-fbb7-4ae8-a6d0-544cac8d6688 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1217 microversion: 2.1 time: 0.608741 Aug 27 03:29:20.083516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 9/18] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:19 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1217 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:20.092667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-230ee21a-248c-4081-86e1-a812eb16aa70 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] HTTP exception thrown: Snapshot 04d435f3-66af-4902-b31e-944bf1cf3aae could not be found. Aug 27 03:29:20.092667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-230ee21a-248c-4081-86e1-a812eb16aa70 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Returning 404 to user: Snapshot 04d435f3-66af-4902-b31e-944bf1cf3aae could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:29:20.092667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-230ee21a-248c-4081-86e1-a812eb16aa70 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae" status: 404 len: 111 microversion: 2.1 time: 0.086485 Aug 27 03:29:20.095483 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 10/19] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:29:20 2021] GET /compute/v2.1/os-snapshots/04d435f3-66af-4902-b31e-944bf1cf3aae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:20.112847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4c8a3ba5-037f-453b-90b1-b06bb209927a tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc6ba670>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.284440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4c8a3ba5-037f-453b-90b1-b06bb209927a tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 202 len: 0 microversion: 2.1 time: 0.185241 Aug 27 03:29:20.285644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 10/20] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:29:20 2021] DELETE /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:20.294607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-02993da0-716d-418a-be2d-24813a53b497 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc729040>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.452028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-02993da0-716d-418a-be2d-24813a53b497 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 200 len: 344 microversion: 2.1 time: 0.161623 Aug 27 03:29:20.459873 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 11/21] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:20 2021] GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:21.021849 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.022760 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:21.042577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:21.043032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:21.052377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:21.052832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:21.099914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.100513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:21.116234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:21.134089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:21.141056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:21.141583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:21.395226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.408766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.410562 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-384d36aa-c285-4104-aca6-1a91711dbdfb tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1219 microversion: 2.1 time: 0.394763 Aug 27 03:29:21.420886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 11/22] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:21 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.425892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-50fb93f2-46a4-48d0-831f-b7fc597406f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1221 microversion: 2.1 time: 0.328361 Aug 27 03:29:21.436316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:21 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1221 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.465639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7e5a7ac3-798f-4dc3-8480-3dbde1a0fa06 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc6ba700>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.567147 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7e5a7ac3-798f-4dc3-8480-3dbde1a0fa06 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 200 len: 344 microversion: 2.1 time: 0.105425 Aug 27 03:29:21.567929 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 12/24] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:21 2021] GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:22.242833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: .version_select at 0x7f6cfc6b3940>, body: {"keypair": {"name": "tempest-keypair-1345526371"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:22.281655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-21eb4274-ace8-41de-b30f-02d07681863d tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc6520d0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.339155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:22.348462 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:22.420029 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-21eb4274-ace8-41de-b30f-02d07681863d tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8a6eef58-d94a-4c21-9d25-a43917c3c514" status: 200 len: 350 microversion: 2.1 time: 0.144078 Aug 27 03:29:22.421902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/os-volumes/8a6eef58-d94a-4c21-9d25-a43917c3c514 => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:22.427430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.428905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:22.453652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:22.454112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:22.454953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:22.458912 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:22.545607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:22.550166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:22.564622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e994ec38-1732-4e86-b759-9a8ff96c9015 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.594077 Aug 27 03:29:22.565986 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 13/26] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Aug 27 03:29:21 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:22.566597 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.578732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-20781435-db84-4426-9b22-0560e9a51b98 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1211 microversion: 2.1 time: 0.151387 Aug 27 03:29:22.578732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 14/27] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:22.583450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c9b99698-9444-48c1-9d79-9e852e70d269 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc643c10>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.593902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.594674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:22.608319 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:22.608866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:22.615448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:22.616380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:22.696534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c9b99698-9444-48c1-9d79-9e852e70d269 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.128933 Aug 27 03:29:22.697675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 14/28] 10.222.0.58 () {58 vars in 1134 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.702440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ef22b655-a43b-49fd-a15c-2a4897e46359 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc611dc0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.735599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-ef22b655-a43b-49fd-a15c-2a4897e46359 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] HTTP exception thrown: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. Aug 27 03:29:22.736562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ef22b655-a43b-49fd-a15c-2a4897e46359 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Returning 404 to user: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:29:22.737655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ef22b655-a43b-49fd-a15c-2a4897e46359 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 404 len: 109 microversion: 2.1 time: 0.038769 Aug 27 03:29:22.738805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:22.744580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ee577e96-9bd6-4a63-be78-13800974bdd0 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc611940>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.790419 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.798362 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0537ef95-7cd1-4335-8bfe-0ffa4d17051a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1269 microversion: 2.1 time: 0.219527 Aug 27 03:29:22.798941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 15/30] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.817633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-edcb2578-1038-45d2-ab0d-cabd1263d8d0 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc671f70>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.856718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-edcb2578-1038-45d2-ab0d-cabd1263d8d0 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] HTTP exception thrown: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. Aug 27 03:29:22.857318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-edcb2578-1038-45d2-ab0d-cabd1263d8d0 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Returning 404 to user: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:29:22.858177 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-edcb2578-1038-45d2-ab0d-cabd1263d8d0 tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 404 len: 109 microversion: 2.1 time: 0.049352 Aug 27 03:29:22.858696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 16/31] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:29:22 2021] DELETE /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:22.949619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ee577e96-9bd6-4a63-be78-13800974bdd0 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.209338 Aug 27 03:29:22.952138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 16/32] 10.222.0.58 () {58 vars in 1149 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:22.960223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1a4d897c-eaef-4390-90b0-d97b271472cb tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Calling method '.version_select at 0x7f6cfc61c1f0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.964558 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: .version_select at 0x7f6cfcf013a0>, body: {"keypair": {"name": "tempest-keypair-531314779"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:23.014336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-1a4d897c-eaef-4390-90b0-d97b271472cb tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] HTTP exception thrown: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. Aug 27 03:29:23.014336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1a4d897c-eaef-4390-90b0-d97b271472cb tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] Returning 404 to user: Volume 7edfa4df-9f14-421e-9712-6cb2c4728620 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:29:23.014336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1a4d897c-eaef-4390-90b0-d97b271472cb tempest-VolumesSnapshotsTestJSON-574883049 tempest-VolumesSnapshotsTestJSON-574883049-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620" status: 404 len: 109 microversion: 2.1 time: 0.046663 Aug 27 03:29:23.014336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 17/33] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:29:22 2021] GET /compute/v2.1/os-volumes/7edfa4df-9f14-421e-9712-6cb2c4728620 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:23.014336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ea2d54d3-4602-4439-ba10-d278a62e41d7 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc7295e0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.021549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:23.027545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:23.161957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ea2d54d3-4602-4439-ba10-d278a62e41d7 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.157491 Aug 27 03:29:23.162746 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 18/34] 10.222.0.58 () {58 vars in 1134 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.174842 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1b77339f-ba57-4b77-bd75-014a8b5336d7 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc61c550>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.276515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:23.287237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:23.331303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-625490e8-9f29-4fd0-b5a0-578094a7094f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.467088 Aug 27 03:29:23.331303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 17/35] 10.222.0.58 () {62 vars in 1199 bytes} [Fri Aug 27 03:29:22 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 469 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:29:23.346573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1b77339f-ba57-4b77-bd75-014a8b5336d7 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.175762 Aug 27 03:29:23.347143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 19/36] 10.222.0.58 () {58 vars in 1167 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:23.362450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cc700806-8bb1-4ddd-a1d6-5f7d145f8139 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc652ee0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.508289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cc700806-8bb1-4ddd-a1d6-5f7d145f8139 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.148934 Aug 27 03:29:23.508932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 18/37] 10.222.0.58 () {58 vars in 1170 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:23.526556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9f6b3e29-f16c-441d-b285-aee5465e0ac3 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc611940>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.607071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.607071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:23.628872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:23.629747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:23.637155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:23.637633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:23.714707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9f6b3e29-f16c-441d-b285-aee5465e0ac3 tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.194729 Aug 27 03:29:23.716135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 20/38] 10.222.0.58 () {58 vars in 1155 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.729849 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fba91d58-d0ec-4b49-a457-54e0f1748e8f tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc61cee0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.879229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fba91d58-d0ec-4b49-a457-54e0f1748e8f tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156037 Aug 27 03:29:23.879964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1188 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:23.886769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.892614 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.896277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a3531e45-56eb-4cb6-a06f-0cc941959a88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1267 microversion: 2.1 time: 0.302331 Aug 27 03:29:23.896972 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:23.902740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.907455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e53a06a2-c186-42cf-bca4-f8b2242c778b tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] Calling method '.version_select at 0x7f6cfc6333a0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.923598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:23.925547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:23.926579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:23.927302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:24.123490 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:24.137806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5f8aed23-fc05-465d-9156-f2e248c0892a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1277 microversion: 2.1 time: 0.256434 Aug 27 03:29:24.138856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 22/41] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:24.267332 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e53a06a2-c186-42cf-bca4-f8b2242c778b tempest-VolumesTestJSON-1604101691 tempest-VolumesTestJSON-1604101691-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.362618 Aug 27 03:29:24.267898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 20/42] 10.222.0.58 () {58 vars in 1155 bytes} [Fri Aug 27 03:29:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:24.918654 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:24.920157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:24.926891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:24.928120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:24.929063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:24.929852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:25.029663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:25.040706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b45376f2-8f59-436c-9f6d-a1cf74752d52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1267 microversion: 2.1 time: 0.125274 Aug 27 03:29:25.045373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 23/43] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:24 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:25.155399 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.156351 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:25.167953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:25.168400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:25.171018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:25.171673 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:25.334749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:25.338678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-78b01a02-9b9d-4a14-a43a-c2ec9e4a9648 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1277 microversion: 2.1 time: 0.181195 Aug 27 03:29:25.338678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:25 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:26.066784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:26.068011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:26.096103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:26.098432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:26.101211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:26.105179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:26.326241 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.345891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-86ecfc25-8c45-4603-98d8-7b98fd4cd93a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1275 microversion: 2.1 time: 0.285144 Aug 27 03:29:26.346512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 24/45] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:26 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:26.361165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:26.361714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:26.378273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:26.390140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:26.391261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:26.391891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:26.601534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.628479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c772bdd7-741e-43fe-9bb6-ac4c7212ae1d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1275 microversion: 2.1 time: 0.270959 Aug 27 03:29:26.634925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 22/46] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:26 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.364918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.367272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:27.390120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:27.391159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:27.392414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:27.392987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:27.652622 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.653475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:27.675064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:27.678704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:27.679795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:27.680566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:27.713564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.729644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d94228f3-41ee-4c82-9b08-efa09ab6d5e0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1273 microversion: 2.1 time: 0.369335 Aug 27 03:29:27.736871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 25/47] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:27 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.799959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1656128295", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2334ee-c3c9-468a-845a-218e819133a7"}], "security_groups": [{"name": "tempest-securitygroup--1176591096"}], "key_name": "tempest-keypair-1345526371", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:27.918476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.933934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-12068f4a-6622-414f-9d90-de6dbfc13f57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1275 microversion: 2.1 time: 0.287505 Aug 27 03:29:27.950742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 23/48] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:27 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:28.458101 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] validate_networks() for [('ff2334ee-c3c9-468a-845a-218e819133a7', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:29:28.642715 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-829454058", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "914ec375-24a4-430c-b691-a84588d24cf3"}], "security_groups": [{"name": "tempest-securitygroup--784311930"}], "key_name": "tempest-keypair-531314779", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:28.848274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] validate_networks() for [('914ec375-24a4-430c-b691-a84588d24cf3', None, None, None, None, None)] {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:29:29.537372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:29.537903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:29.538231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:29.538674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:29.539080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:29.549280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.549937 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.550741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.551165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.580527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:29.584565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:29.603267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:29:29.605552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:29:29.665028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e25ac843-53bc-4e5e-b36b-f49abf5eca2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.870048 Aug 27 03:29:29.669041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 26/49] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:29:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:29.674171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.674787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:29.686032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.686757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.687941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.688386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.694174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:29.694795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:29.695304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:29.695814 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:29.696342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:29.709686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.710135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.711242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.711726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.738722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:29:29.742874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:29:29.754807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:29:29.757021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:29:29.811799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6e9cf735-0e96-4fac-b6c7-dca0c02dded1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.173495 Aug 27 03:29:29.813002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 24/50] 10.222.0.58 () {62 vars in 1188 bytes} [Fri Aug 27 03:29:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:29:29.817564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.818342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:29.826383 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.827125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.828161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:29.828590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:29.931194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:29.939329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a299f87e-f51a-49b2-8a0a-b44ccbb020b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.268927 Aug 27 03:29:29.942640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 27/51] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:29 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:29.949599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8deefb71-b8b0-4439-90cf-274a4ccc4e61 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.954335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8deefb71-b8b0-4439-90cf-274a4ccc4e61 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:30.077789 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8deefb71-b8b0-4439-90cf-274a4ccc4e61 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.084803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8deefb71-b8b0-4439-90cf-274a4ccc4e61 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1238 microversion: 2.1 time: 0.140818 Aug 27 03:29:30.085768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:29 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1238 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.092729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.100846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.106889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:30.109446 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-be59e945-c9dc-4ff6-8883-47cce0f3ad7b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.295274 Aug 27 03:29:30.121843 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 25/53] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:29 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.186341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.197141 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.198865 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.200129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-271fcd7b-c338-4ab1-921a-18b3201fa9f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1280 microversion: 2.20 time: 0.111229 Aug 27 03:29:30.208456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 29/54] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:30 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:30.958153 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.959060 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:30.970977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:30.971600 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:30.972491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:30.972939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.099405 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.107697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1b5a36bb-8fa0-482c-a721-1071a11289d3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.153103 Aug 27 03:29:31.108365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 26/55] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:30 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:31.109272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.109854 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:31.116437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.117187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.118206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.118640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.133779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.134376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:31.142586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.143251 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.144199 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.144774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.206140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.213593 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d493056d-9592-48dc-8e7b-4af0cbc43699 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.107991 Aug 27 03:29:31.214172 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 30/56] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:31 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:31.219452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.220131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:31.227539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.227975 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.228744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:31.229166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:31.319193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.327513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.328999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.330118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e06bc109-0035-4a15-939d-0478804060fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.114122 Aug 27 03:29:31.330860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 31/57] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:31 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:29:31.333217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.341049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dfc83918-febe-49df-901c-8a4b35e5e75f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.211222 Aug 27 03:29:31.341671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 27/58] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:31 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:32.124022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.124631 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:32.131081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.131563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.135881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.135881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.230084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.230696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:32.237553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.238234 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.239492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.240489 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.269955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.277645 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9de24af2-5619-43f1-a04a-a380fe667dd0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.157507 Aug 27 03:29:32.278259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 32/59] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:32 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:32.301482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.310336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-153442ce-ce5d-45b8-9535-14c3c3eec621 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.083943 Aug 27 03:29:32.311104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 28/60] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:32 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:32.355077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.355818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:32.357329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.358151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:32.363801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.364215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.365009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.365438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.369086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.370259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.371261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:32.371952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:32.458111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.466577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.468118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.469366 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6b2d0d27-d426-4166-b6d1-c0bf3ba25686 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.122874 Aug 27 03:29:32.470276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 33/61] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:32 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:32.579259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.593065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2caeda93-af18-4b26-af89-74e99fdf526f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.238867 Aug 27 03:29:32.595523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 29/62] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:32 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:33.294984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:33.296013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:33.310435 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.311081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.311897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.312328 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.328063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:33.328642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:33.336247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.336528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.337495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.338362 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.427654 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.436626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-75bf5fcf-46dd-4128-a0d0-99a5ed0b652e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.112573 Aug 27 03:29:33.437426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 30/63] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:33 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:33.494914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:33.496732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:33.505225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.505938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.506731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.507209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.512514 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.521870 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-04f13593-6a66-49f5-9ea9-ac51b5bf38ff tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.231071 Aug 27 03:29:33.523071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 34/64] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:33 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:33.599583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.611081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:33.611944 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:33.619528 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.620767 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.621711 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:33.622322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:33.635394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.646592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.648774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c3a34469-fb00-4dca-9f00-cd5bd7684ec1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.158275 Aug 27 03:29:33.649867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 31/65] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:33 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:33.795385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.802630 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f3c7a658-ecfd-48aa-8b46-5cba0375b5a7 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.195819 Aug 27 03:29:33.803514 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 35/66] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:33 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.455816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.456547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:34.464512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.465068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.466043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.466600 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.539117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.540031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:34.544877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.552338 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-95874aa8-940b-414f-8074-772329f0978f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.101941 Aug 27 03:29:34.552531 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.552923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 32/67] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:34 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.553068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.553765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.554720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.672300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.673727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:34.682378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.683099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.684472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.685105 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.741945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.757030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b7b3d470-7975-4c10-9b43-2e5c435245cd tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.217335 Aug 27 03:29:34.759329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 36/68] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:34 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:34.793112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.808409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.810125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.811267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-71165e30-48c2-443a-b14e-45fe7e5efe27 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.147048 Aug 27 03:29:34.825093 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 33/69] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:34 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:29:34.828274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.828880 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:34.836019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.836607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:34.837496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:34.838025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.012205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:35.020722 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8ba01553-1114-4fb1-9e24-d769f385e1b5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.195993 Aug 27 03:29:35.022036 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 37/70] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:34 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:35.574774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:35.575836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:35.595969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.596891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.597896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.598331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.721768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:35.738544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-46b75b67-a125-4999-995e-08c5b3407117 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.168794 Aug 27 03:29:35.753879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 34/71] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:35 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:35.775796 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:35.776418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:35.787474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.788005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.789044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.789582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.833259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:35.833873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:35.845552 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.850409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:35.853931 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:35.854665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:36.000025 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.022352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.022512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.023790 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-148f4cac-2923-4cfa-b37a-54d227e7cef4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.194836 Aug 27 03:29:36.024780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 35/72] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:35 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:36.038506 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:36.039266 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:36.058545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:36.058996 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:36.059811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:36.060244 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:36.109058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.117845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6a86f23d-1107-4f1f-b93e-bd0990528498 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.346626 Aug 27 03:29:36.122886 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 38/73] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:35 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:36.281668 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.290914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-11d0a9a8-2261-4f63-b41a-bbaf60e1d437 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.255857 Aug 27 03:29:36.291681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 36/74] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:36 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:36.768935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:36.769539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:36.776045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:36.776696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:36.777248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:36.777682 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:36.849197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.858779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-95f0f950-7722-4806-a54b-dad41631115f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.093432 Aug 27 03:29:36.859463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 39/75] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:36 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:37.049070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.049557 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:37.059169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.059675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.060455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.060881 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.138742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.139382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:37.142568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.149027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.149478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.150989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.151095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.158887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.163246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.166367 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-86df5561-1051-4c03-9294-fbd3f473ec95 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.121571 Aug 27 03:29:37.167899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 37/76] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:37 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:37.320202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.328052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:37.341975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.342683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.344215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.345233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.401869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.412911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b5e60d5e-984f-40f9-8500-e39afbab88f6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.277776 Aug 27 03:29:37.414030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 40/77] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:37 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:37.581537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.591096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-975bd169-b52f-4a37-b0b1-8700e395f4ae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.284127 Aug 27 03:29:37.591699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 38/78] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:37 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:37.875253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.877106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:37.892402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.892850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.893626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:37.894053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:37.995303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.008076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d1e49862-dae4-4bf6-8359-654b7848e45c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.136264 Aug 27 03:29:38.009234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 41/79] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:37 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:38.187140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.188079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:38.196823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.197496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.198791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.199417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.281645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.290752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.293043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.295308 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ff36533f-de33-4f4b-ba5a-2ba9a226cb2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.112705 Aug 27 03:29:38.310679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 39/80] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:38 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:38.430919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.431562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:38.437420 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.438066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.438997 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.439593 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.607649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.608521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:38.616696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.617355 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.618584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:38.619422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:38.771543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.780124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-55e90fc5-1ae0-4e98-a4e2-41f823d9b6c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.353718 Aug 27 03:29:38.780698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:38 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:38.872995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.881318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8c0e73d8-42b6-46e7-8cac-253f41507603 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.277222 Aug 27 03:29:38.881948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 40/82] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:38 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:39.025565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.026255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:39.032342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.032853 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.033704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.034318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.110383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.119019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-54ec8766-f53e-49b6-83ae-57233ec8eb7f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.097014 Aug 27 03:29:39.119620 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 43/83] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:39 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:39.320548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.321168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:39.334317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.334788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.336042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.342302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.480184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.489194 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.490657 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.497262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a97a6174-fd92-4aa3-9901-20032251e72a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.182812 Aug 27 03:29:39.499623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 41/84] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:39 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:39.813204 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.816546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:39.844954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.845753 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.849520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.849984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.901609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.902756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:39.910884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.911547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:39.912623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:39.913495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:40.112935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.122112 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-97e941d5-a30e-4c28-967b-65f150d0e81b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.327178 Aug 27 03:29:40.123557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 44/85] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:39 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.145126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:40.151206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:40.161847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:40.162287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:40.163071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:40.163585 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:40.196073 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.204720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f0dd1258-305b-4731-a5b8-32b24f6b94a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.308666 Aug 27 03:29:40.205575 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 42/86] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:39 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.232628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.260807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bc3dc095-efd2-4740-b754-7a410d38caa6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.119153 Aug 27 03:29:40.261756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:40 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.518622 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:40.519923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:40.526346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:40.526922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:40.527802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:40.528437 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:40.596845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.606250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.608110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.609196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d28d5fc3-924e-4c30-a9c9-7227cdf56e70 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.095325 Aug 27 03:29:40.610054 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 43/88] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:40 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:41.141164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.141768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:41.148117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.148558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.149310 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.149729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.222353 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.223082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:41.230031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.230660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.231796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.232030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.306205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.313840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7bf15cef-9ed5-49f3-9583-68bdd8b70771 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.176644 Aug 27 03:29:41.324591 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 46/89] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:41 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.327897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.328509 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:41.334299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.334739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.336003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.336142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.377686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.386366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-efe367b0-40d9-44f6-b94e-572b251ecf1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.167711 Aug 27 03:29:41.395621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 44/90] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:41 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.401838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.408746 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-64cbce0e-aa21-42e7-ac71-7a5e7b61ab03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.093064 Aug 27 03:29:41.409473 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 47/91] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:41 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.628523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.629106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:41.635479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.635981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.636735 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:41.637185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:41.698922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.706903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.708456 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.709543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b8ddbf5f-9d60-4a91-b99a-756e7b94b2ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.084729 Aug 27 03:29:41.710145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 45/92] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:41 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:42.331817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.332338 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:42.338319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.338758 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.339543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.339973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.403007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.403662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:42.409991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.410429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.411186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.411882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.510951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.519285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-79544a2c-3af1-4530-b7c9-7b53def123c0 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.191625 Aug 27 03:29:42.520092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 48/93] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:42 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:42.529259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.529259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:42.532661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.533101 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.533960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.534553 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.715401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.723295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b6d814a7-251d-4aad-8c05-0e3bc55a45b7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1242 microversion: 2.1 time: 0.202007 Aug 27 03:29:42.723807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 49/94] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:42 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:42.728150 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.728747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:42.730832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.735742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.736523 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.737663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:42.737764 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:42.742779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0e87fdf7-186d-41cf-bd55-ad753d73d626 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.343815 Aug 27 03:29:42.743951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 46/95] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:42 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:42.805829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.814430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.816002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.817083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-29dff902-f6ab-4b71-8131-6eeec7c1e57f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1284 microversion: 2.20 time: 0.092330 Aug 27 03:29:42.817634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 50/96] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:42 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:43.537404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.538151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:43.544430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.545090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.546121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.546608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.740343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.741103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:43.747135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.747730 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.748590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.749262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.861595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:43.871864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:43.872371 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-169d07a3-c867-42b5-8800-b895aa5e16f5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1234 microversion: 2.1 time: 0.135494 Aug 27 03:29:43.873463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 51/97] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:43 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1234 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:43.879920 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.881223 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-67dc3932-31c8-428e-9016-8f16f0db7c93 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.348396 Aug 27 03:29:43.882456 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 47/98] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:43 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:43.882589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:43.888978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.889868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:43.892061 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.892558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.893669 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.894269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.897890 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.900437 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.901479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:43.902106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:43.995798 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.005871 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.008356 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.009807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4422006f-f2f2-4cbc-9fe8-4d57c356a6cf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1332 microversion: 2.20 time: 0.125777 Aug 27 03:29:44.010583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 48/99] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:43 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:44.117084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.124864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-aa622932-12ee-4273-9ee8-1d28b2665a34 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.249748 Aug 27 03:29:44.125595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 52/100] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:43 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:44.484846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-b91a61f8-673b-4d9d-a7e2-109cd3e71c4c req-2a5c5bbb-c0ab-48bf-b85b-899e50ad351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881", "tag": "bad6539d-473a-4ae7-8574-1eba84cbf59d"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:44.487032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:44.487032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:29:44.496582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b91a61f8-673b-4d9d-a7e2-109cd3e71c4c req-2a5c5bbb-c0ab-48bf-b85b-899e50ad351c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.497032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b91a61f8-673b-4d9d-a7e2-109cd3e71c4c req-2a5c5bbb-c0ab-48bf-b85b-899e50ad351c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.515867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-b91a61f8-673b-4d9d-a7e2-109cd3e71c4c req-2a5c5bbb-c0ab-48bf-b85b-899e50ad351c service nova] Creating event network-changed:bad6539d-473a-4ae7-8574-1eba84cbf59d for instance 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 on hv-cinder-80473 Aug 27 03:29:44.516472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b91a61f8-673b-4d9d-a7e2-109cd3e71c4c req-2a5c5bbb-c0ab-48bf-b85b-899e50ad351c service nova] Acquired lock "compute-rpcapi-router" {{(pid=108336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 03:29:44.517560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.517981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.518742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.519154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.529072 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.compute.rpcapi [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 03:29:44.529911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] Releasing lock "compute-rpcapi-router" {{(pid=108336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 03:29:44.556677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-49a4ae39-4aac-4191-bf0d-a3cb48cbca17 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139625 Aug 27 03:29:44.557259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 49/101] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:44.624050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-7d1350d2-73c6-4d41-8392-0fbee744c0f8 req-f9496b4a-4f59-49d1-9186-309a561788d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d004af-5dc0-4616-a2e3-bcab38f12bff", "tag": "e929609b-218e-4f62-8bc9-1c229af8d765"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:44.626246 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:44.626246 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:29:44.636454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-7d1350d2-73c6-4d41-8392-0fbee744c0f8 req-f9496b4a-4f59-49d1-9186-309a561788d7 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.636889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-7d1350d2-73c6-4d41-8392-0fbee744c0f8 req-f9496b4a-4f59-49d1-9186-309a561788d7 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.657913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-7d1350d2-73c6-4d41-8392-0fbee744c0f8 req-f9496b4a-4f59-49d1-9186-309a561788d7 service nova] Creating event network-changed:e929609b-218e-4f62-8bc9-1c229af8d765 for instance 70d004af-5dc0-4616-a2e3-bcab38f12bff on hv-cinder-80473 Aug 27 03:29:44.658492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-7d1350d2-73c6-4d41-8392-0fbee744c0f8 req-f9496b4a-4f59-49d1-9186-309a561788d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108335) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 03:29:44.659843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.660274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.661050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.661473 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.670428 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.compute.rpcapi [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 03:29:44.671335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] Releasing lock "compute-rpcapi-router" {{(pid=108335) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 03:29:44.697290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f5db0eeb-20f9-417a-8379-f3646a2d68be None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133398 Aug 27 03:29:44.698212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 53/102] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:44.891420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:44.892062 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:44.899460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.899923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.900144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:44.900680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.900877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:44.901141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.907309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.907782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.908601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:44.909035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:44.972408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.980786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f4bb6cd9-f564-4b58-b7d7-db630c313ef2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1234 microversion: 2.1 time: 0.093702 Aug 27 03:29:44.981341 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 50/103] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:44 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.028392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.029022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:45.034893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:45.035338 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:45.036127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:45.036550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:45.048684 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.057840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b52d6594-1ae8-40ad-853b-4a3d4dd61736 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.162120 Aug 27 03:29:45.058371 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 54/104] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:44 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.105282 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.117017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.118548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.119648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-706103bc-72b6-44e2-b5d1-475b3da9d69d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1332 microversion: 2.20 time: 0.094974 Aug 27 03:29:45.120246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 51/105] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:45 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:45.144804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.145644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:45.152572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:45.153004 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:45.153762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:45.154160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:45.289669 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.300542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6ca5f999-16e6-4d90-8c91-a10b7750a7b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.161726 Aug 27 03:29:45.301308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 55/106] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:45 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.997983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.999131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:46.008228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.008665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.009513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.009933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.074151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.074846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:46.079236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.081350 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.081788 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.082537 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.083157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.086683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bc63f5ad-9c0d-4f9d-9b24-a8f0cecd25ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1234 microversion: 2.1 time: 0.093350 Aug 27 03:29:46.087389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 52/107] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:45 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:46.137699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.138284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:46.145869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.146573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.147726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.148157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.218010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.226870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.228394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.229480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e691b9b7-aae0-4c62-8ee2-7d2e15285be4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1332 microversion: 2.20 time: 0.095568 Aug 27 03:29:46.230043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 53/108] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:46 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:46.235339 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.242766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-25f77d28-e2fa-4887-b414-60c557b1af52 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.172252 Aug 27 03:29:46.243327 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 56/109] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:46 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:46.325945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.326841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:46.337183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.337621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.338423 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:46.338838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:46.473874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.482161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-59cf5a1f-ef89-4996-a553-d9d73f82ed02 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.162474 Aug 27 03:29:46.482891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 54/110] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:46 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:47.105577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.106862 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:47.113345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.114050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.115012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.115788 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.206533 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.214160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-980cc44a-f15c-4f99-a5aa-4e2b0d6f4ff8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1290 microversion: 2.1 time: 0.114199 Aug 27 03:29:47.214699 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 57/111] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:47 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:47.249144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.249959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:47.256115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.256833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.257899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.258682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.259879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.260485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:47.266438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.267570 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.268588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.269288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.339986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.348172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.349764 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.350877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-207f7985-ad2c-43c2-94d2-db0b93661a9a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1338 microversion: 2.20 time: 0.106554 Aug 27 03:29:47.351488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 55/112] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:47 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:47.497395 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.501271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.502061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:47.504866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ac9ed675-bdbe-4bd4-964b-0c8fc2c7ee95 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.248863 Aug 27 03:29:47.505717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 58/113] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:47 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:47.515751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.516125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.517351 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:47.517783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:47.696458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.706230 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f199e2d2-36c4-4800-93a2-7e35de7ed951 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.208547 Aug 27 03:29:47.707477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 56/114] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:47 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:48.236206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.237250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:48.247414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.248329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.249647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.250368 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.314372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.322434 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c74b2a44-39ef-40e5-83ae-87b17f49724c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1290 microversion: 2.1 time: 0.093503 Aug 27 03:29:48.323024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 59/115] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:48 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:48.371095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.371615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:48.380469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.381020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.382202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.382640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.513300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.521283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.521451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.521944 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:48.522785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.523906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4b6c23ed-b84e-4aef-895e-a30430d36b5c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.157687 Aug 27 03:29:48.524644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 57/116] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:48 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:48.528135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.528621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.529493 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.529922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.660332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.668260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-18004386-8e06-47f9-98cd-0a9101bafaa2 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.150567 Aug 27 03:29:48.668858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 60/117] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:48 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:48.728693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.729681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:48.739755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.740491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.741885 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:48.742129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:48.878932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.889570 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-27510581-ed36-4787-af3c-9e06662a2233 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.167205 Aug 27 03:29:48.890135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 58/118] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:48 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.341245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.341929 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:49.350564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.351503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.352656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.353221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.428110 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.437058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b7c7044d-2291-45a7-b6cd-64365ae61410 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1290 microversion: 2.1 time: 0.101264 Aug 27 03:29:49.437633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 61/119] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:49 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.547739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.549404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:49.558363 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.558802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.559604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.560004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.685567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.686148 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:49.693715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.694137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.694897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.695316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.714449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.727515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.730097 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.731531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-14debbdc-d869-4602-b23b-aad6fd782209 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.191291 Aug 27 03:29:49.732157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 59/120] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:49 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:49.880140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.896399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d21d5f7f-e649-4b9d-b876-2259821ef8ca tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.214612 Aug 27 03:29:49.897921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 62/121] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:49 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.912190 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.913337 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:49.920442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.920926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:49.921808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:49.922817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.398056 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.407257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2ec2407f-59d0-46ed-8086-7b39b49dfea6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.498849 Aug 27 03:29:50.407840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 60/122] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:49 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:50.456543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.457085 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:50.465120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.465713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.466963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.467633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.557838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.565276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1fbd621f-1b4b-459a-a22e-2715cda58a90 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1296 microversion: 2.1 time: 0.112618 Aug 27 03:29:50.565897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 63/123] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:50 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:50.749947 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.751262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:50.757847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.758291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.759216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.759667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.845396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-a6235c36-22d0-4092-b4c9-e27c49295486 req-09e34e76-9005-4a12-a99a-b9900f1811ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:50.847106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:50.847106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:29:50.854453 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a6235c36-22d0-4092-b4c9-e27c49295486 req-09e34e76-9005-4a12-a99a-b9900f1811ea service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.855213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a6235c36-22d0-4092-b4c9-e27c49295486 req-09e34e76-9005-4a12-a99a-b9900f1811ea service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.885668 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-a6235c36-22d0-4092-b4c9-e27c49295486 req-09e34e76-9005-4a12-a99a-b9900f1811ea service nova] Creating event network-changed:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:29:50.894783 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-a6235c36-22d0-4092-b4c9-e27c49295486 req-09e34e76-9005-4a12-a99a-b9900f1811ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053275 Aug 27 03:29:50.895780 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 64/124] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:50.914665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.915374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:50.921556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.921987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.922751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:50.923496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:50.926815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.935665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.937314 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.938406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-24735d3e-2ecb-46c0-9082-dfd85cd09f2d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.192471 Aug 27 03:29:50.948851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 61/125] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:50 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:51.051500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.059124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-366ba620-53c7-4a6b-ad06-a9abde06d121 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.148794 Aug 27 03:29:51.059759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 65/126] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:50 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:51.425922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:51.426522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:51.433228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.433643 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:51.434436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.434942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:51.557225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.564945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c773ef13-fb64-40bc-88d0-02aabb8c3a91 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.142766 Aug 27 03:29:51.565508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 62/127] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:51 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:51.581954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:51.582512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:51.589225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.589664 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:51.590409 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.590824 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:51.655941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.663627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2018580c-fb51-4c38-8a56-c51575863a3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1296 microversion: 2.1 time: 0.085120 Aug 27 03:29:51.664196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 66/128] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:51 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:51.958490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:51.959527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:51.967318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.968675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:51.969441 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:51.969868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.077964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.078875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:52.087371 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.087814 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.088580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.089146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.110871 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.119903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.121399 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.122499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ad52d016-d254-4f34-9d5d-1a432fc2ed01 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.170151 Aug 27 03:29:52.123058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 63/129] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:51 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:52.212930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.220811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d3074940-2b54-4c07-8a1c-ca92a474d72b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.148421 Aug 27 03:29:52.221387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 67/130] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:52 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:52.589329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.590322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:52.600712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.601460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.602349 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.602777 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.681479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.682037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:52.688390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.688837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.689610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:52.690041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:52.746344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.753820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7bcdf524-a80c-49b0-98bc-025cb40c5140 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.171289 Aug 27 03:29:52.754383 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 64/131] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:52 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:52.761006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.771649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c82210f8-8421-46f7-a68a-9a2c39a87cb6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1296 microversion: 2.1 time: 0.094095 Aug 27 03:29:52.772693 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 68/132] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:52 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:53.140491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.141170 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:53.147162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.147972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.148741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.149167 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.237754 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.239213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:53.245897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.246663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.247485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.247919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.576950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.584875 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.586660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.587852 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4d1a10b2-95d1-4dd2-bb79-d0f01d1e0a75 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.451190 Aug 27 03:29:53.588460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 65/133] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:53 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:53.599805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.608232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-74283204-40a5-4b0c-afe7-1ec1f74b0112 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.373959 Aug 27 03:29:53.608871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 69/134] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:53 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:53.770041 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.770637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:53.777068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.777500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.778272 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.778708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.788942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.789568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:53.795914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.796448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:53.797259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:53.797835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:54.020679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.028364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-91fe31e1-eae2-4fb2-b94e-efd003a06cdf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1296 microversion: 2.1 time: 0.243373 Aug 27 03:29:54.028931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 70/135] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:53 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1296 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:54.136871 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.144608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-451ea23f-03f1-4a93-a6c2-f09c912b3aae tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.378270 Aug 27 03:29:54.145486 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:53 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:54.606011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:54.606607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:54.612357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:54.612811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:54.613558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:54.613975 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:54.625206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:54.625804 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:54.631768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:54.632242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:54.633001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:54.633546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:54.792766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.797269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.801347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.802857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.804655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b4aacc4f-ec0e-4010-a699-d675bcefac74 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.183072 Aug 27 03:29:54.805074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c999e6fb-3eaf-44d2-87d1-289c4c01e6bc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.201718 Aug 27 03:29:54.805525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 67/138] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:54 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:54.805653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 71/138] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:54 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:55.048470 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.049071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:55.055890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.056334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.057092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.057508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.161330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.161968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:55.168215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.168641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.169407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.169866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.193240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.200662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-29065957-9824-434f-a248-49daefc9d3df tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.155809 Aug 27 03:29:55.201252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 72/139] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:55 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:55.295238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.305927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5db1e6f0-ec07-4ad9-b316-443c1c488dfe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.148185 Aug 27 03:29:55.306495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 68/140] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:55 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:55.825605 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.826410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:55.827232 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.828319 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:55.835939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.836383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.836896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.837146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.837311 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.837565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:55.838095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:55.838510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:56.018731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.025338 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.027552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-951ee8f4-5279-4bd6-ba26-b5e9c9a19483 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.208404 Aug 27 03:29:56.028538 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 73/141] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:55 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:56.036122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.037606 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.038954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f8bd95e3-2a5a-487f-9c5a-d4b292583db8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.217648 Aug 27 03:29:56.039540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 69/142] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:55 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:56.221312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:56.222265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:56.229838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:56.230273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:56.231045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:56.231472 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:56.328455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:56.329077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:56.335611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:56.336178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:56.336952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:56.337377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:56.695904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.704340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-780d8563-c954-4782-8903-f759abc628f3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.489378 Aug 27 03:29:56.705087 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 74/143] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:56 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:56.765563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.773038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1b6b3b94-6041-45b6-914b-dc668c524bba tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.448349 Aug 27 03:29:56.773791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 70/144] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:56 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:57.045373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.047005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:57.056401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.057059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.057912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.058655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.069665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.070590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:57.084242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.087497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.088556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.089191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.362440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.368556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.377507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f93e1cdb-89d4-4a9b-bce2-c974f2f6895f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.336293 Aug 27 03:29:57.377840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.379626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.379749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 75/145] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:57 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:57.381067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-80ad5342-1910-4d97-b07a-fee6be564d23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.327790 Aug 27 03:29:57.385081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-2eb00df0-3410-4477-8eb9-30b8139814e5 req-cef49673-ea6e-42c9-b088-91b767bb2671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b798f8be-ccdf-4eec-b4dc-9216b13eba31", "tag": "00f4f309-41f4-4e94-86a4-ef0178135a23"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:57.386954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:57.386954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:29:57.389070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 71/146] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:57 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:57.395945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2eb00df0-3410-4477-8eb9-30b8139814e5 req-cef49673-ea6e-42c9-b088-91b767bb2671 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.396406 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2eb00df0-3410-4477-8eb9-30b8139814e5 req-cef49673-ea6e-42c9-b088-91b767bb2671 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.408016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-2eb00df0-3410-4477-8eb9-30b8139814e5 req-cef49673-ea6e-42c9-b088-91b767bb2671 service nova] Creating event network-changed:00f4f309-41f4-4e94-86a4-ef0178135a23 for instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 on hv-cinder-80473 Aug 27 03:29:57.413069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-2eb00df0-3410-4477-8eb9-30b8139814e5 req-cef49673-ea6e-42c9-b088-91b767bb2671 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032203 Aug 27 03:29:57.413672 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 76/147] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:57.724646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.725801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:57.731930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.732385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.733140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.733567 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.790076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.790750 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:57.797258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.797689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.798440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:57.798859 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:57.880768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.888517 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a0669bf2-c471-4257-ab2d-ce2d3c9cecaa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.169858 Aug 27 03:29:57.890095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 72/148] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:57 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:57.943739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.951963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b78b8683-d1dd-465c-8548-b3036cc1f24f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.165967 Aug 27 03:29:57.952500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 77/149] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:57 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:58.394582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.395259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:58.399534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.400052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:58.402478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.402913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.403720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.404150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.406317 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.406825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.407687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.408159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.584613 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.588540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.596380 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.598729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.601039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8b2faf6f-1275-468a-b096-6bc7f6590db1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.204663 Aug 27 03:29:58.601264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-20d4eab9-c701-4d4f-a76a-aa0770c638a5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.209863 Aug 27 03:29:58.611390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 73/150] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:58 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:58.611596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 78/151] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:58 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:58.907009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.907633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:58.914094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.914530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.915274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.915731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.973010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.973980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:58.983787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.984627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:58.985889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:58.986671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:59.083881 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.091997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-87c6adf9-04e0-419c-9310-67a6ee7195ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.188637 Aug 27 03:29:59.092646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 74/152] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:58 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:59.133335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.140713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-be6818ca-5237-4f5d-ac5b-a6a05e2c0993 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.173922 Aug 27 03:29:59.141274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 79/153] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:58 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:59.619568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:59.620248 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:59.620637 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:59.620728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:29:59.626776 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:59.626914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:59.627271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:59.627477 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:59.628063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:59.628224 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:29:59.628483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:29:59.628825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:00.187826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.195097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.197596 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-91d55a2e-f081-467d-876b-3c6126e1ae60 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.583399 Aug 27 03:30:00.202272 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 75/154] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:29:59 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:00.204418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.206707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.208149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fd160fb5-261f-4e45-9214-99f42b811737 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.592422 Aug 27 03:30:00.219967 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:00.220165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 80/155] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:29:59 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:00.220256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:00.222866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:00.223477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:00.223988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:00.224858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:00.225024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:00.231612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:00.235651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:00.236396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:00.237804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:00.239025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:00.610712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.622576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.624753 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e2bf0b09-e524-46e0-a2f4-ff135c24dc2b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.421314 Aug 27 03:30:00.629787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 76/156] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:00 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:00.637834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-53f86252-5657-4fdd-b33f-96d66c0f1732 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.423630 Aug 27 03:30:00.642837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 81/157] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:00 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:01.220063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.220709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:01.226845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.227471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:01.227870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.228574 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.229607 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.230405 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.233339 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.233845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.234612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.235032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.417025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.426666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.429558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.430027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.431508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8e3f163c-6d29-4716-a9e8-c0f313ee0cc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.208181 Aug 27 03:30:01.433268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 82/158] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:01 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:01.437939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c51430a4-fd42-4897-b29e-cff5f24bbd2f tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.221806 Aug 27 03:30:01.438561 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 77/159] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:01 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:01.641026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.641628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:01.650143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.657150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.657735 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:01.659777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.660626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.661073 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.670143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.670549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.671378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:01.671861 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:01.898378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.909251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1d80d215-cdb2-4e1f-b681-63ccad958a4e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.271689 Aug 27 03:30:01.910189 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.911378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 83/160] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:01 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:01.941429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4241d9a0-32b0-4fd7-9ca1-6a401079a69d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.288840 Aug 27 03:30:01.943490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 78/161] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:01 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:02.455924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.456528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:02.459052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.459788 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:02.474193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.474602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.474913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.476404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.477422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.477719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.478922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.479132 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.727791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.732578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.737581 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d85c9157-9c3a-402e-928d-43852d895a2d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.285975 Aug 27 03:30:02.739242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 79/162] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:02 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:02.747527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.749545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.750809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b0bd5e31-71c5-4dd0-90e7-bab4ce7fc12e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.302791 Aug 27 03:30:02.761822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 84/163] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:02 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:02.927832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.928559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:02.935162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.935709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.936540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.937036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.961041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.962122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:02.969459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.970370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:02.971636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:02.972204 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:03.136974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.148492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b1e79ea6-37e5-43f0-8dbe-ae9c7150a959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.220342 Aug 27 03:30:03.149463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 80/164] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:02 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:03.227299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.244767 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f613798c-d175-4a3f-a686-f4f4ffda2a42 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.288514 Aug 27 03:30:03.247433 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 85/165] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:02 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:03.754752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.755629 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:03.763483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:03.763943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:03.764634 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:03.765057 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:03.769891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.773575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:03.781532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:03.782752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:03.784200 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:03.784817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:04.046276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.048581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.055547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c6c5b966-f45b-44e3-9f8a-7cf51b533171 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.304444 Aug 27 03:30:04.056440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 81/166] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:03 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:04.061491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.063797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.065250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7c4b91ca-262d-4c0f-91bb-3cea49ef060c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.299329 Aug 27 03:30:04.066109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 86/167] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:03 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:04.165777 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.167371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:04.179478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:04.180642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:04.182090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:04.182666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:04.263747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.264484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:04.275716 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:04.278082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:04.281703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:04.282344 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:04.392109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.400169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1fa9b6d8-d012-4b39-aba9-0640e13edda2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.239141 Aug 27 03:30:04.404237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 82/168] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:04 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:04.477277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.488407 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7a03cab7-12d6-4c86-9aba-b6fbde9e0340 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.228846 Aug 27 03:30:04.492799 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 87/169] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:04 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:05.073972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.075263 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:05.083507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.084086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.085194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.085922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:05.086425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.087246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.095182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.096126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.096906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.097330 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.293479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.298967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.302801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c9e58d58-2748-4dde-918e-df68aa5822a9 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.233657 Aug 27 03:30:05.303477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 83/170] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:05 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.311648 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.313721 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.314840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-add52c62-ca13-4890-a8ed-4b79b2e06546 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.234267 Aug 27 03:30:05.315576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 88/171] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:05 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:05.420523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.421510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:05.431457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.431457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.431457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.431457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.510577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.511455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:05.520568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.521153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.522020 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:05.523189 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:05.622195 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.632333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-036b47a8-dbbb-4e4f-891e-8c3def33a270 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.214482 Aug 27 03:30:05.633067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 84/172] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:05 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.717724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.725295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0b0fb3a0-e126-402b-9c85-73251be715fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.219381 Aug 27 03:30:05.726729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 89/173] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:05 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:06.322716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.323996 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:06.332905 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.334164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:06.343600 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.346319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.347258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.348259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.350549 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.351619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.352638 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.354354 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.560096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.571092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.575058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.576236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.579158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e9f36f31-4f73-434b-b887-a540f5f704d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.250108 Aug 27 03:30:06.589418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-833b7862-e807-415c-bf27-57950d5165c3 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.269356 Aug 27 03:30:06.591323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 85/175] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:06 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:06.600836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 90/175] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:06 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:06.653231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.653841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:06.662117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.662911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.664218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.664800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.745911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.746532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:06.778797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.779242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.780112 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:06.780547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:06.877679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.886890 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5692a2be-e3e8-46c8-a8ad-ecba10bef03c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.240161 Aug 27 03:30:06.887665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 86/176] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:06 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:06.941784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.950418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1d784005-8978-42d9-91a3-f4fafb014881 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.210221 Aug 27 03:30:06.951330 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 91/177] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:06 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:07.597030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.597628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:07.604058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.604442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.605201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.605619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.606340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.607077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:07.613109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.613560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.614311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.614753 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.796837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.805073 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.812442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.813571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4a3213fc-f00c-49d5-88fd-4ec69b0aaf07 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.210979 Aug 27 03:30:07.814157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 92/178] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:07 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:07.814366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.815909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fe4b6929-4fa7-4229-9a66-4933a79a45eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.222364 Aug 27 03:30:07.816790 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 87/179] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:07 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:07.908270 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.909008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:07.917988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.918441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.919656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.920025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.968401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.968611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:07.974605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.975088 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:07.976008 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:07.976530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:08.113446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.120898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7c00a6db-a0a2-4517-b6f8-a7caec86cb21 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.216245 Aug 27 03:30:08.121681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 93/180] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:07 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:08.146544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.154557 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bfcc24d8-a8d0-4ac3-a33c-e6e26e169cd0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.190638 Aug 27 03:30:08.155040 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 88/181] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:07 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:08.831766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.832450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:08.837990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.838590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:08.838919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:08.839383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:08.840253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:08.840571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:08.844546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:08.844968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:08.845723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:08.846175 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:09.201838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.204455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.210971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d9d7038f-ba32-449a-9de5-ac3d2e9aabd6 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.382454 Aug 27 03:30:09.212032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 94/182] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:08 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:09.212903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.214559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.215847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6470a575-b432-44e2-b01f-c746fa555d0b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.382057 Aug 27 03:30:09.216682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 89/183] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:08 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:09.219908 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.220736 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:09.223278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.223918 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:09.228038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:09.228717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:09.229678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:09.230233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:09.230586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:09.231206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:09.232018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:09.232440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:09.432686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.440268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-07213313-f0e0-4f1a-85a3-61030993d4fe tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.222459 Aug 27 03:30:09.440833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 90/184] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:09 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:09.450497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.458121 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6d8a1554-49c7-44e6-9369-89c9c931fbc6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.244840 Aug 27 03:30:09.458691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 95/185] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:09 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:10.227858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.228425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:10.233892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.234568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:10.235895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.236313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.237250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.237842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.241520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.242227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.243193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.243636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.476153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.486804 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.492312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.494006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.495662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cf5551a6-ef2c-44bd-8af3-d7ac86f90e88 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.265643 Aug 27 03:30:10.496207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 96/186] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:10 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:10.500638 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.501124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:10.507579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.507747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44481ca9-71ba-41cb-b2a5-7e815fb944c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.270206 Aug 27 03:30:10.508336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 91/187] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:10 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:10.508545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.509509 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.510097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.520863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.523538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:10.531368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.532750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.534751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:10.535303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:10.739667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.749492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-45c2f909-0d58-4d7e-8fa9-2bc140ff577f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.252177 Aug 27 03:30:10.750096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 97/188] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:10 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:10.760275 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.769847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f4c4737d-e247-43ef-b287-134c52456a08 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.260372 Aug 27 03:30:10.771061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 92/189] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:10 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:11.522041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.522576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:11.525652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.526313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:11.528709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.529154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.529927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.530355 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.532633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.533067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.533869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.534312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.759202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.770660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-800e5b71-0664-4b89-88ec-aa7b63365a1a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.249302 Aug 27 03:30:11.771235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 93/190] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:11 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:11.778787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.792655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:11.805075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.805713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.813191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.813794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.822612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.830711 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.838139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.842855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4c88e8ea-9a76-47ae-a76b-1a41b2995bac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.325455 Aug 27 03:30:11.856703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 98/191] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:11 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:11.869567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.870650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:11.878708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.880412 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:11.881877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:11.882633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.103093 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.105950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.118031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8abe3c7e-5dab-486f-aacd-8742559f1508 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.259782 Aug 27 03:30:12.118997 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 99/192] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:11 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:12.121789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7d033c22-1605-45ff-a4ea-1a128dff1cf8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.345453 Aug 27 03:30:12.136295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 94/193] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:11 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:12.299628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-7f1abba8-6df4-4567-9bda-b01155f4a711 req-37805f4d-3512-4963-b955-b6bfbb0657c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881", "name": "network-vif-plugged", "status": "completed", "tag": "bad6539d-473a-4ae7-8574-1eba84cbf59d"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:12.301455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:12.301455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:30:12.311663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-7f1abba8-6df4-4567-9bda-b01155f4a711 req-37805f4d-3512-4963-b955-b6bfbb0657c3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:12.312948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-7f1abba8-6df4-4567-9bda-b01155f4a711 req-37805f4d-3512-4963-b955-b6bfbb0657c3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.326029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-7f1abba8-6df4-4567-9bda-b01155f4a711 req-37805f4d-3512-4963-b955-b6bfbb0657c3 service nova] Creating event network-vif-plugged:bad6539d-473a-4ae7-8574-1eba84cbf59d for instance 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 on hv-cinder-80473 Aug 27 03:30:12.332794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-7f1abba8-6df4-4567-9bda-b01155f4a711 req-37805f4d-3512-4963-b955-b6bfbb0657c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212312 Aug 27 03:30:12.334641 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 100/194] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:12.789173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:12.789632 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:12.796298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:12.796720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.797481 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:12.797969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.867854 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:12.868548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:12.876714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:12.877158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.878595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:12.878595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:12.965134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.990236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5db848ad-ee08-4804-9295-0787aaa41278 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.205528 Aug 27 03:30:13.000298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 95/195] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:12 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:13.075592 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.087748 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.089681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.090900 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a53961b6-e9d4-4095-b23c-645561fa91b9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.227510 Aug 27 03:30:13.091540 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 101/196] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:12 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:13.136031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:13.136631 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:13.139316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:13.140106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:13.145238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:13.145678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:13.146876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:13.147498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:13.148228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:13.148578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:13.148875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:13.149356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:13.346233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.356462 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-792c10d6-05af-431d-bae0-9c617fb2b764 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.221028 Aug 27 03:30:13.357927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 102/197] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:13 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:13.369781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.385783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0426949a-a470-4522-a945-36d8fc18234a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.254134 Aug 27 03:30:13.387941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 96/198] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:13 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:14.012249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.013471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:14.021142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.021858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.022837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.023519 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.112320 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.113568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:14.123519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.123961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.124733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.129139 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.372992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.384500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-efe3a3a5-ab9d-4567-9a1a-6da4c59fd05d tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.381535 Aug 27 03:30:14.394096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:14 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:14.403765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "name": "network-vif-plugged", "status": "completed", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}, {"server_uuid": "70d004af-5dc0-4616-a2e3-bcab38f12bff", "name": "network-vif-plugged", "status": "completed", "tag": "e929609b-218e-4f62-8bc9-1c229af8d765"}, {"server_uuid": "b798f8be-ccdf-4eec-b4dc-9216b13eba31", "name": "network-vif-plugged", "status": "completed", "tag": "00f4f309-41f4-4e94-86a4-ef0178135a23"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:14.405897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:14.405897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:30:14.417014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.417818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.454405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Creating event network-vif-plugged:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:30:14.455274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.459971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Creating event network-vif-plugged:e929609b-218e-4f62-8bc9-1c229af8d765 for instance 70d004af-5dc0-4616-a2e3-bcab38f12bff on hv-cinder-80473 Aug 27 03:30:14.460335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] Creating event network-vif-plugged:00f4f309-41f4-4e94-86a4-ef0178135a23 for instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 on hv-cinder-80473 Aug 27 03:30:14.465104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.470039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.473598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-b1acfd21-f16a-4b95-aef7-aff149c09e5a req-00a821f3-7a34-4dfb-a6a6-9b56a2723bb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077510 Aug 27 03:30:14.474115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-78d9eebf-c2fa-49ac-81e8-cf76b3570798 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.367423 Aug 27 03:30:14.476107 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 104/200] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:14.479045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 97/201] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:14 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:14.484676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.485537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:14.499031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.502633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.503169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.504861 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.505192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:14.506411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.520194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.524393 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.525372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:14.527370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:14.780162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.791168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-56c1377a-f948-4b79-8b1f-4525e0d21496 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1317 microversion: 2.1 time: 0.310603 Aug 27 03:30:14.796455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 105/202] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:14 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:14.910995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.921914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6255e387-ed7a-4f16-bd79-6dfbc4fa9b52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.440441 Aug 27 03:30:14.922495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 98/203] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:14 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:15.409916 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.411545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:15.417459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.417902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.418947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.419547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.496774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.505294 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:15.517969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.525577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.526546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.527126 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.580994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.594274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b15f7e83-ec1f-4469-b6f4-2706f757f15c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.188048 Aug 27 03:30:15.595343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 106/204] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:15 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:15.688840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.697284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.698934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.700236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-52eab15c-147d-45e2-8f3c-bbe089646a0f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1405 microversion: 2.20 time: 0.207571 Aug 27 03:30:15.711175 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 99/205] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:15 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:15.813801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.814686 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:15.821381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.822155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.823528 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.824050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.941518 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.942195 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:15.952887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.953952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:15.956725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:15.957218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:16.041148 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:16.050441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fa7ce179-4339-4db2-b917-df6334624fa5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1507 microversion: 2.1 time: 0.240834 Aug 27 03:30:16.052182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 107/206] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:15 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:16.235944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:16.246467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9ed77738-4077-47b9-b816-65a225a851fb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.308334 Aug 27 03:30:16.248043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 100/207] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:15 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:16.613760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.614447 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:16.625013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:16.627120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:16.628090 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:16.630899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:16.720502 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.721362 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:16.729661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:16.732847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:16.733939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:16.771924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:16.866123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:16.878737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-519df574-6905-4778-b87b-d3d74256c9da tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1315 microversion: 2.1 time: 0.270882 Aug 27 03:30:16.879833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 108/208] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:16 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:17.075395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.084209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.085875 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.088862 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aa92e36d-52fa-4632-8584-6f218c92f0eb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1597 microversion: 2.20 time: 0.374557 Aug 27 03:30:17.093620 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 101/209] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:30:16 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1597 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:17.117763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.118360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:17.141694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.142179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.143454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.144265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.269904 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.270583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:17.288611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.290420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.291870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.293561 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.411108 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e91cc3c0-f086-4690-ac0e-e4d8ff94b15d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.301403 Aug 27 03:30:17.424067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 109/210] 10.222.0.58 () {60 vars in 1316 bytes} [Fri Aug 27 03:30:17 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:17.563825 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.574079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8b508f78-e71b-486d-b71c-647b78748874 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1364 microversion: 2.1 time: 0.313312 Aug 27 03:30:17.583951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 102/211] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:17 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:17.615206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "035ddf83-f10a-486e-8dd2-de074b8c3979"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:17.618268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:17.626051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.626705 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.627678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.628227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.896569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.897889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:17.910146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.910804 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:17.913092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:17.914665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:18.165197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a18187d1-b4e2-44d1-b14a-6c2d28fb419b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553953 Aug 27 03:30:18.169772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 110/212] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:30:17 2021] POST /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:18.449686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:18.463397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-390c3c05-6cac-4e9b-9e75-a4a5e2b95a9c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1503 microversion: 2.1 time: 0.565165 Aug 27 03:30:18.463397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 103/213] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:17 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:18.594270 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.595520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:18.617959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:18.619869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:18.626707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:18.628345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:18.876443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:18.885324 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3268a009-9887-4a90-ae94-6de0c5d01929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1550 microversion: 2.1 time: 0.297891 Aug 27 03:30:18.886017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 111/214] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:18 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1550 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:18.906121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.906638 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:18.922363 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:18.923034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:18.924074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:18.927176 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:19.122199 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7c3a4685-6c26-453c-82c6-6719fa13c48e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222332 Aug 27 03:30:19.122782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 104/215] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Aug 27 03:30:18 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:19.616632 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-ea1cea04-40f6-4d31-99d6-1efdbd5ceec7 req-a7fdbfeb-baa9-41f4-918d-844dc70f5baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:19.616890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:19.618745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:19.618745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:30:19.620290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:19.636304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:19.637375 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:19.639667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ea1cea04-40f6-4d31-99d6-1efdbd5ceec7 req-a7fdbfeb-baa9-41f4-918d-844dc70f5baa service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:19.640333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ea1cea04-40f6-4d31-99d6-1efdbd5ceec7 req-a7fdbfeb-baa9-41f4-918d-844dc70f5baa service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:19.641984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:19.643230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:19.674806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-ea1cea04-40f6-4d31-99d6-1efdbd5ceec7 req-a7fdbfeb-baa9-41f4-918d-844dc70f5baa service nova] Creating event network-changed:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:30:19.685776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-ea1cea04-40f6-4d31-99d6-1efdbd5ceec7 req-a7fdbfeb-baa9-41f4-918d-844dc70f5baa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074675 Aug 27 03:30:19.687082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 105/216] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:30:19.779601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-443c3b0f-6873-4807-9ccf-dff0b71dc71d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.172370 Aug 27 03:30:19.780869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 112/217] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:19 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:20.303506 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e6ac83-cf09-4c3c-9a63-a85b54f6a24c"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:20.309436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:20.328391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:20.330224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:20.331113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:20.332443 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:20.792438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:20.794803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:20.808838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:20.810704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:20.814000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:20.816014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:20.927503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7e90a599-d5db-4a9a-b7a1-79df0e9efcc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.140523 Aug 27 03:30:20.928616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 113/218] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:20 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:20.983157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c8f0b84a-b86a-4565-b8fb-d60e6e6e8cd5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "POST /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681154 Aug 27 03:30:20.995845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 106/219] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:30:20 2021] POST /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:21.942338 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:21.945244 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:21.959913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:21.961450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:21.963025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:21.963792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:22.045466 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-18548f42-e871-4ec2-b789-8492783fdd38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.109675 Aug 27 03:30:22.048026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 114/220] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:21 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:22.504353 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:22.505492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:22.523253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-6e7576b8-3547-48c2-9e96-de9301a913f9 req-c3c160a0-74ee-49cf-98d4-c8144dc5193b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b798f8be-ccdf-4eec-b4dc-9216b13eba31", "tag": "00f4f309-41f4-4e94-86a4-ef0178135a23"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:22.524800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:22.524800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:30:22.539160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:22.542799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:22.543800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:22.544237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:22.546582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6e7576b8-3547-48c2-9e96-de9301a913f9 req-c3c160a0-74ee-49cf-98d4-c8144dc5193b service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:22.549398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6e7576b8-3547-48c2-9e96-de9301a913f9 req-c3c160a0-74ee-49cf-98d4-c8144dc5193b service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:22.586007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-6e7576b8-3547-48c2-9e96-de9301a913f9 req-c3c160a0-74ee-49cf-98d4-c8144dc5193b service nova] Creating event network-changed:00f4f309-41f4-4e94-86a4-ef0178135a23 for instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 on hv-cinder-80473 Aug 27 03:30:22.596815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-6e7576b8-3547-48c2-9e96-de9301a913f9 req-c3c160a0-74ee-49cf-98d4-c8144dc5193b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079172 Aug 27 03:30:22.602209 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 115/221] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:22.681581 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2634c34a-60a0-4f76-91e3-8fb48a462300 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.183258 Aug 27 03:30:22.682684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 107/222] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:22 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:23.065709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:23.066927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:23.082373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:23.083647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:23.084583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:23.085007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:23.199282 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b356999e-b770-48f4-b353-aa83f53693c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.138027 Aug 27 03:30:23.200343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 116/223] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:23 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:23.700222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:23.706917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:23.716751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:23.717542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:23.719800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:23.720330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:23.830474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6a65540c-5850-4d43-abd7-86d99ba4ec6c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.139881 Aug 27 03:30:23.831077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 108/224] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:23 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:24.212139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:24.213151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:24.220273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.220959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.222265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.222689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.310708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a8e5a42a-7758-4091-ae34-159820400923 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.103114 Aug 27 03:30:24.311443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 117/225] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:24 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:24.841869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:24.842888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:24.849747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.850202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.851211 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:24.851480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:24.943530 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5b321e49-4657-4a26-b73b-7f6ea2c8e76e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.105311 Aug 27 03:30:24.945247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 109/226] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:24 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:30:25.322581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:25.323895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:25.332795 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:25.333226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:25.334214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:25.334214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:25.418267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-40035cc3-0cb4-4b3b-bb0b-552ae5b790f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.099995 Aug 27 03:30:25.418908 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 118/227] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:25 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:25.955645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:25.956567 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:25.963909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:25.964609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:25.965528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:25.965942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:26.041932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bc08d7a6-49e0-4993-b9aa-efaebdee33ad tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.090147 Aug 27 03:30:26.045035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 110/228] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:25 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:26.429922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:26.431600 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:26.438411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:26.438886 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:26.439762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:26.440188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:26.535569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-86e2e065-f2e1-42a3-9c54-984e2926f4fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.109809 Aug 27 03:30:26.536528 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 119/229] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:26 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:27.054218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:27.056244 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:27.062985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:27.063653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:27.064579 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:27.065424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:27.147923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e29dee8a-e692-4652-b17b-99fde6c8dc84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.097862 Aug 27 03:30:27.149200 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 111/230] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:27 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:27.264826 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924718100", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:27.548981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:27.549893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:27.557295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:27.557950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:27.558765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:27.559268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:27.636671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-429e9cad-64fe-4683-869e-49e553447b7e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.093208 Aug 27 03:30:27.637299 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 112/231] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:27 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:28.159948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:28.161716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:28.168937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:28.169382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:28.170221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:28.170818 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:28.247545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-21e30757-cc3e-4b22-93a5-81f031540737 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.091423 Aug 27 03:30:28.248231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 113/232] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:28 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:30:28.648998 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:28.650104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:28.659997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:28.660444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:28.661655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:28.662699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:28.746074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bebf3628-225b-4a0d-b43e-0596a6eba329 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.102514 Aug 27 03:30:28.747026 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 114/233] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:28 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:29.259161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:29.260185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:29.268266 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:29.269003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:29.270064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:29.270525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:29.358754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a94b0cb8-0f35-4846-8c97-f2823bb296bb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.103890 Aug 27 03:30:29.359729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 115/234] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:29 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:29.760806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:29.764531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:29.776800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:29.777544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:29.778323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:29.778745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:29.878431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f94226aa-0a59-475f-b2b5-ca3154822dbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.123060 Aug 27 03:30:29.879612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 116/235] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:29 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:30.370130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:30.373143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:30.383388 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:30.384601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:30.388201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:30.388201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:30.464324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d5733c31-8727-4c18-9c1f-de5913f267a7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.098291 Aug 27 03:30:30.465476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 117/236] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:30 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:30:30.890452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:30.891527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:30.898834 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:30.899274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:30.900084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:30.900515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:30.975888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bf678861-a5ee-483f-8532-8121447a875d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.089791 Aug 27 03:30:30.976561 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 118/237] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:30 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:31.476921 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:31.477977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:31.487396 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:31.487820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:31.488592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:31.489023 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:31.582914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dc5251a7-41ec-4e58-89b4-e03dfe5bb953 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14 microversion: 2.1 time: 0.110193 Aug 27 03:30:31.587310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 119/238] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:31 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:30:31.988720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:31.989733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:31.996903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:31.997370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:31.998138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:31.998596 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:32.070503 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5c7775f3-fc46-4a09-bc25-22ec4a140ede tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 14 microversion: 2.20 time: 0.086428 Aug 27 03:30:32.071142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 120/239] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:31 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:32.595320 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:32.596266 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:32.603400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:32.603830 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:32.604803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:32.605355 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:35.854863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e3eb04f6-00ef-4c4e-a9ca-9e2e31fbed8e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 5365 microversion: 2.1 time: 3.263149 Aug 27 03:30:35.855366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 121/240] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:32 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 5365 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:35.861895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:35.864417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:35.869909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:35.870345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:35.871176 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:35.871653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:35.999208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7bc0294e-29d9-4205-b460-a217de106db6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 6451 microversion: 2.20 time: 0.142660 Aug 27 03:30:35.999959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 122/241] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:35 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:36.866314 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:36.867576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:36.875044 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:36.875716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:36.876636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:36.877090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:36.995298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-687dee2f-75d1-419b-b93b-07afcacadaec tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 8048 microversion: 2.1 time: 0.132888 Aug 27 03:30:36.996476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 123/242] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:36 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 8048 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:37.011435 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:37.012676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:37.019553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.019991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.020756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.021310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.154439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-11bb7dfb-6c2c-4d8c-82da-033f315c0532 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 9798 microversion: 2.20 time: 0.147396 Aug 27 03:30:37.155116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 124/243] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:37 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 9798 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:37.303121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:37.304009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:37.320744 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.321181 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.321949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.322462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.353017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:30:37.459157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b697dce7-d41a-47ea-b456-38abad1a0f57 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "DELETE /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 204 len: 0 microversion: 2.1 time: 0.160448 Aug 27 03:30:37.460015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 125/244] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:30:37 2021] DELETE /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:37.468714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:37.469469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:37.476902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.477300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.478238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:37.478671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:37.646547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.658324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8866897e-87f4-467f-a1f9-6364f42f7d9a tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1555 microversion: 2.1 time: 0.194014 Aug 27 03:30:37.659087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 126/245] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:37 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:38.005945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:38.006889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:38.012970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.013404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.014143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.014592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.105925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b40f62d9-4420-4f3a-bcc7-8ef67538b722 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 11050 microversion: 2.1 time: 0.103432 Aug 27 03:30:38.106607 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 127/246] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:38 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 11050 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:30:38.172902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:38.174212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:38.184410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.185061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.186114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.186693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.281771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f821676a-4e20-4a40-b931-299bcdf8be2b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 13175 microversion: 2.20 time: 0.115447 Aug 27 03:30:38.282329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 128/247] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:38 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 13175 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:38.677281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:38.678205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:38.685652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.686152 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.686919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:38.687381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:38.813846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:38.822328 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-466d70a6-cd43-4ba7-82be-9149a25534c5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1555 microversion: 2.1 time: 0.149333 Aug 27 03:30:38.822902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 129/248] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:38 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:39.118450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:39.119822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:39.125911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.126347 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.127111 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.127592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.229095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-74225ac8-e507-4a79-acb1-3db41f0c4177 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 14772 microversion: 2.1 time: 0.114326 Aug 27 03:30:39.230808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 130/249] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:39 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 14772 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:30:39.294168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:39.295139 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:39.302405 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.303092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.304216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.305109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.406287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-28e46632-4af9-40e3-afaf-3c0b27583fac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 15412 microversion: 2.20 time: 0.115963 Aug 27 03:30:39.407091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 131/250] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:39 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 15412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:39.839893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:39.840586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:39.849762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.850274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.851075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:39.851534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:39.983476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:39.991655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-027d3f54-ca41-498a-a133-19417e6253b5 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1555 microversion: 2.1 time: 0.155861 Aug 27 03:30:39.992228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 132/251] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:39 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:40.241863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:40.242860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:40.249418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:40.249860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:40.250642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:40.251064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:40.337099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-de704905-e694-441a-9e4b-4c8dc95baf9f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 16422 microversion: 2.1 time: 0.099059 Aug 27 03:30:40.337897 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 133/252] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:40 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 16422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:40.420401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:40.421519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:40.428822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:40.429268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:40.430495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:40.430924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:40.520872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e3e305b8-cc38-4b47-8749-59afb6c8d6cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 17717 microversion: 2.20 time: 0.104738 Aug 27 03:30:40.521646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 134/253] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:40 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 17717 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:40.995777 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-ebeba1ed-a9f3-4973-90fe-e7a96e8f6bdb req-e7da452a-b520-490b-9b8b-018081089b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d004af-5dc0-4616-a2e3-bcab38f12bff", "name": "network-vif-deleted", "tag": "e929609b-218e-4f62-8bc9-1c229af8d765"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:40.997520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:40.997520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:30:41.005616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ebeba1ed-a9f3-4973-90fe-e7a96e8f6bdb req-e7da452a-b520-490b-9b8b-018081089b67 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.006146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ebeba1ed-a9f3-4973-90fe-e7a96e8f6bdb req-e7da452a-b520-490b-9b8b-018081089b67 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.023236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-ebeba1ed-a9f3-4973-90fe-e7a96e8f6bdb req-e7da452a-b520-490b-9b8b-018081089b67 service nova] Creating event network-vif-deleted:e929609b-218e-4f62-8bc9-1c229af8d765 for instance 70d004af-5dc0-4616-a2e3-bcab38f12bff on hv-cinder-80473 Aug 27 03:30:41.029480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-ebeba1ed-a9f3-4973-90fe-e7a96e8f6bdb req-e7da452a-b520-490b-9b8b-018081089b67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037817 Aug 27 03:30:41.030110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 135/254] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:30:41.035808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:41.036533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:41.050300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.051077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.051903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.052584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.238956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b514a1dc3cc642f2b83ba52eb39b4420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba5a01bf20b47e4a67299b2f5aa032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.244208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fea8d661-1fc4-4c69-9bca-bec05a6b5d88 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 200 len: 1346 microversion: 2.1 time: 0.212922 Aug 27 03:30:41.253559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 136/255] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:41 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 1346 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:41.360789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:41.361699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:41.369366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.369802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.370563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.370978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.458302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b3cdbc45-9aa4-4c6a-93df-0d68684e0a1a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 17861 microversion: 2.1 time: 0.112252 Aug 27 03:30:41.474357 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 137/256] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:41 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 17861 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:41.542086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:41.544352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:41.553484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.553926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.555286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:41.555946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:41.647562 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4ca45f9e-977e-4ecf-b982-d3f81c91309c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 18509 microversion: 2.20 time: 0.114209 Aug 27 03:30:41.648350 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 138/257] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:41 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 18509 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:42.271079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:42.274956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:42.289556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.290500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.291987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.293089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.314824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] HTTP exception thrown: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. Aug 27 03:30:42.315562 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Returning 404 to user: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:30:42.316527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a462e208-3171-4a4e-b899-f5cc768f2a18 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 404 len: 111 microversion: 2.1 time: 0.059407 Aug 27 03:30:42.317250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 139/258] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:42 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:42.471709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:42.472879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:42.478868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.479297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.480291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.480716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.578190 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-168c4cf7-7824-43ba-ba80-e68bec75a3d6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 19342 microversion: 2.1 time: 0.109972 Aug 27 03:30:42.580235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 140/259] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:42 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:30:42.586789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:42.587843 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:42.595271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.595779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.596554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.597038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.611375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] HTTP exception thrown: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. Aug 27 03:30:42.611964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Returning 404 to user: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:30:42.612765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-70a98dd8-6e39-4fcf-a84d-64d4a8d5386b tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031060 Aug 27 03:30:42.617166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 141/260] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:30:42 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:42.660808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:42.660808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:42.671377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.671738 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.673014 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:42.673792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:42.774037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-37f789da-6a72-4077-ad00-fedfe20294ae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 20173 microversion: 2.20 time: 0.119246 Aug 27 03:30:42.775385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 142/261] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:42 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 20173 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:43.591916 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:43.592948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:43.613390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.614239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.615374 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.618569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.720821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dba10ab5-88ae-42d9-b09e-8251efb4c9e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 20991 microversion: 2.1 time: 0.133009 Aug 27 03:30:43.721933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 143/262] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:43 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 20991 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:43.786556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:43.787872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:43.794886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.795552 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.796501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.797104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.818451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] validate_networks() for [('a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:30:43.903592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3e17dc25-75ce-4aaf-b754-c69115ea74fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 21884 microversion: 2.20 time: 0.120907 Aug 27 03:30:43.904364 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 144/263] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:43 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 21884 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:43.909787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.912056 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:43.922295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.922881 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.923684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.924276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.954813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] HTTP exception thrown: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. Aug 27 03:30:43.955753 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Returning 404 to user: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:30:43.956783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9a660c7a-158e-4b21-8927-f3ce3fc2bd36 tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "DELETE /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 404 len: 111 microversion: 2.1 time: 0.051031 Aug 27 03:30:43.957587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 145/264] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:30:43 2021] DELETE /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:43.965719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.966651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] [instance: 70d004af-5dc0-4616-a2e3-bcab38f12bff] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:43.972995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.973610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:43.974598 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:43.975170 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.004186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] HTTP exception thrown: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. Aug 27 03:30:44.008258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] Returning 404 to user: Instance 70d004af-5dc0-4616-a2e3-bcab38f12bff could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:30:44.009107 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d9d531b8-da0e-4010-8ba8-82f85eb0512c tempest-DeleteServersTestJSON-631827844 tempest-DeleteServersTestJSON-631827844-project] 10.222.0.58 "GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff" status: 404 len: 111 microversion: 2.1 time: 0.047277 Aug 27 03:30:44.009670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 146/265] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:43 2021] GET /compute/v2.1/servers/70d004af-5dc0-4616-a2e3-bcab38f12bff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:30:44.383689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:44.384353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:44.384910 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:44.385431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:44.385898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:44.401445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.401945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.402800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.403278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.421277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:30:44.430305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for user b0959c5e5b1c49a9b5395f90360ce934 and project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:30:44.444009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:30:44.448477 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:30:44.511288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e1e16332-307a-46aa-92ad-4ab720784666 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.250637 Aug 27 03:30:44.512583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 120/266] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:30:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 17253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:30:44.523618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0a47f577-9ff0-4bc5-8ede-c09c4f0c51a9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.524219 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0a47f577-9ff0-4bc5-8ede-c09c4f0c51a9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:44.601604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0a47f577-9ff0-4bc5-8ede-c09c4f0c51a9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.616455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0a47f577-9ff0-4bc5-8ede-c09c4f0c51a9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1218 microversion: 2.1 time: 0.096929 Aug 27 03:30:44.617200 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 147/267] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:44 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:44.733672 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:44.734917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:44.746382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.747586 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.748361 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.751872 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.836474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7708d8c5-cc59-46d1-9da0-f20de330e7ae tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 22547 microversion: 2.1 time: 0.106976 Aug 27 03:30:44.838323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 121/268] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:44 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 22547 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:44.915209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:44.916059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:44.924619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.925080 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:44.925974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:44.926354 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:45.050834 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0814b375-6328-44e1-8370-fe8739176533 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 22982 microversion: 2.20 time: 0.139841 Aug 27 03:30:45.051495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 148/269] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:44 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 22982 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:45.634197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:45.634985 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:45.643318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:45.643808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:45.644589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:45.645008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:45.714361 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.722876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8b8aaeab-f337-44cf-8d6a-01d4c4cfe904 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1270 microversion: 2.1 time: 0.093131 Aug 27 03:30:45.724301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 122/270] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:45 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:45.851439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:45.852640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:45.863531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:45.864625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:45.866586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:45.868594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:45.994614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b073b318-0ef6-44a5-adce-1e04002a0724 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 23233 microversion: 2.1 time: 0.148483 Aug 27 03:30:45.998550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 149/271] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:45 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 23233 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:46.063064 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:46.064145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:46.081574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:46.082038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:46.083836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:46.084607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:46.184474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-da87d5ec-cb98-4b11-94eb-177672ea5910 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 23598 microversion: 2.20 time: 0.125813 Aug 27 03:30:46.185250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 123/272] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:46 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 23598 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:46.741109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:46.742035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:46.765233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:46.766345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:46.767795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:46.768781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:46.975731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.987036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1d21aeef-009d-4cd5-9846-a92076fbcbb4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.250267 Aug 27 03:30:46.992563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 150/273] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:46 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:47.008494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:47.009855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:47.016800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:47.017543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:47.018549 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:47.019187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:47.130932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6503fcea-28f7-46ce-bbde-e1fcfc0693e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 23801 microversion: 2.1 time: 0.126689 Aug 27 03:30:47.131630 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 124/274] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:47 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 23801 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:47.199144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:47.200208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:47.212915 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:47.213799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:47.214746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:47.219489 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:47.328803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d760d500-6328-48d5-8138-fd016eea2ba5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 24107 microversion: 2.20 time: 0.133745 Aug 27 03:30:47.330666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 151/275] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:47 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 24107 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:47.886871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-99fbded3-2db4-4f73-99ca-20531395dd8b req-9631c53c-d44b-49f4-a098-d5031434530d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90527ef8-4d61-4bc5-8ecc-ed05837e0dc5", "tag": "81dbe444-5db9-4391-bed2-2330c577d434"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:47.889241 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:47.889241 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:30:47.900062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-99fbded3-2db4-4f73-99ca-20531395dd8b req-9631c53c-d44b-49f4-a098-d5031434530d service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:47.900957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-99fbded3-2db4-4f73-99ca-20531395dd8b req-9631c53c-d44b-49f4-a098-d5031434530d service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:47.939340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-99fbded3-2db4-4f73-99ca-20531395dd8b req-9631c53c-d44b-49f4-a098-d5031434530d service nova] Creating event network-changed:81dbe444-5db9-4391-bed2-2330c577d434 for instance 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 on hv-cinder-80473 Aug 27 03:30:47.945505 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-99fbded3-2db4-4f73-99ca-20531395dd8b req-9631c53c-d44b-49f4-a098-d5031434530d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063002 Aug 27 03:30:47.946757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 125/276] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:48.013858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:48.014563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:48.038302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.039776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.040741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.041172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.145171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:48.146384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:48.153127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.153565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.154510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.155285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.250924 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f9ccf551-affa-4249-8651-d463c020aa01 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 24451 microversion: 2.1 time: 0.112120 Aug 27 03:30:48.251610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 126/277] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:48 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 24451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:48.296196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.304092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dea825ee-215c-458a-903a-15195db3b768 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.298153 Aug 27 03:30:48.305129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 152/278] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:48 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:48.343273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:48.344650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:48.351796 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.352232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.353059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:48.353651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:48.469226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c7491a39-4e1c-4871-810a-4fc5ee64f0a2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 24686 microversion: 2.20 time: 0.130664 Aug 27 03:30:48.472978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 127/279] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:48 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 24686 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:49.266848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:49.268573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:49.282013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.282481 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.283294 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.283781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.326043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:49.327921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:49.344554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.347712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.349011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.350171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.424564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5d34ec50-5c88-490b-b1e6-8ba397fc540a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 24995 microversion: 2.1 time: 0.164322 Aug 27 03:30:49.425344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 153/280] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:49 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 24995 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:49.485085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:49.486611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:49.505463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.506268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.510840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:49.511284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:49.666485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-09cb6ecc-956f-490c-b658-5924b3401ef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 25341 microversion: 2.20 time: 0.186388 Aug 27 03:30:49.668441 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 154/281] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:49 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 25341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:49.737844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.751696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e78b2f5d-ed4f-44b7-8e0e-9e7b53904a5c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.432478 Aug 27 03:30:49.754400 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 128/282] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:49 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:50.438576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:50.439906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:50.447478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.447945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:50.448733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.449150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:50.544458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-752622fd-92ae-4f4b-8904-0de777f25603 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 25940 microversion: 2.1 time: 0.110932 Aug 27 03:30:50.545131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 155/283] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:50 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 25940 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:50.680719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:50.681738 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:50.701925 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.702443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:50.703399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.705562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:50.771119 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:50.772052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:50.781458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.791844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:50.792876 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:50.793276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:51.452429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:51.460750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5416af09-cb95-4fbd-84bd-7d774638a704 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.694150 Aug 27 03:30:51.470449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 156/284] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:50 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:51.570836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:51.572565 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:51.587812 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:51.589066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:51.590269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:51.590912 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:54.039017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1f1b3f89-a0df-48ea-83e9-e2213e0c9433 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 27555 microversion: 2.20 time: 3.362918 Aug 27 03:30:54.040489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 129/285] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:50 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 27555 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:54.050308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:54.051285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:54.059196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:54.059945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:54.060973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:54.061649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:54.074601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-87134523-63cc-48ca-9b5b-89ed178bfdf9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 27510 microversion: 2.1 time: 2.521403 Aug 27 03:30:54.076529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 157/286] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:51 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 27510 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:30:54.288159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.299315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4092ea77-1c22-4644-8582-eea493db94b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.253236 Aug 27 03:30:54.299971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 130/287] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:54 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:54.325648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-177499088", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49eed060-6837-4e18-bdb1-2b63d9669339"}]}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:54.434701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] validate_networks() for [('49eed060-6837-4e18-bdb1-2b63d9669339', None, None, None, None, None)] {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:30:54.930761 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:54.931241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:54.931904 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:54.932809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:54.933527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:54.952323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:54.953103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:54.954137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:54.955396 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:54.977127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Getting quotas for project dec8900e772c45c583c5e85e9958d95d. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:30:54.986227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Getting quotas for user 81d8642de4a64b80b0a85d69663e2f91 and project dec8900e772c45c583c5e85e9958d95d. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:30:55.012441 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:30:55.015121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:30:55.053663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:55.056745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:55.065999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.067136 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.068368 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.069277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.112191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f2082b65-c40b-4a9a-9e94-ae16844bc563 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.034261 Aug 27 03:30:55.124499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 158/288] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:30:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:30:55.130701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:55.144844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:55.154784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.156256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.157246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.158012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.189000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1b965149-c777-47ce-9b9e-fbbe9c5cda0a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 27838 microversion: 2.20 time: 0.139308 Aug 27 03:30:55.189705 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 131/289] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:55 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 27838 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:55.197228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d3b9c08e-6153-44aa-b752-1912eee2e225 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:55.198601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d3b9c08e-6153-44aa-b752-1912eee2e225 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:55.268507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5c0be6e0-5921-4872-bfc1-a81f01fb417f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 27811 microversion: 2.1 time: 0.142422 Aug 27 03:30:55.269213 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 159/290] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:55 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 27811 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:55.312263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d3b9c08e-6153-44aa-b752-1912eee2e225 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.319045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d3b9c08e-6153-44aa-b752-1912eee2e225 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1221 microversion: 2.1 time: 0.127808 Aug 27 03:30:55.322585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:55.323132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 132/291] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:55 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:55.325465 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:55.345038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.346784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.348178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:55.350722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:55.454441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-500600533", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49eed060-6837-4e18-bdb1-2b63d9669339"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:55.588647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] validate_networks() for [('49eed060-6837-4e18-bdb1-2b63d9669339', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:30:55.646891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.664076 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bb443bf2-9d2a-4a60-8fea-6af7f22d4d2a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.347886 Aug 27 03:30:55.667720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 160/292] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:55 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:56.206687 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:56.208095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:56.214783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.215218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.216015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.216434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.364026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:56.365034 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:56.366196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:56.366787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:56.367716 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:56.382080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.382823 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.383941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.384557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.441428 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Getting quotas for project dec8900e772c45c583c5e85e9958d95d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:30:56.454733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Getting quotas for user 81d8642de4a64b80b0a85d69663e2f91 and project dec8900e772c45c583c5e85e9958d95d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:30:56.465146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8bc8e00b-0ca6-42d7-9397-2c6e8df5eed1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28181 microversion: 2.20 time: 0.266567 Aug 27 03:30:56.468268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 161/293] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:56 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28181 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:56.470393 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:30:56.474705 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:30:56.477697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:56.479102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:56.499047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.500146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.504605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.505358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.601786 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f7489f9e-9e43-45a2-8319-1dc1f74730b2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.147590 Aug 27 03:30:56.605396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 133/294] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:30:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:30:56.615488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5f113875-80a4-4d33-90e4-14e1493cc938 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:56.616518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5f113875-80a4-4d33-90e4-14e1493cc938 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:56.634898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e6f67956-deed-4e64-a40f-94e1d7b2b78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28230 microversion: 2.1 time: 0.164604 Aug 27 03:30:56.635877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 162/295] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:56 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28230 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:56.683009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:56.684426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:56.699703 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.700406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.702372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:56.706903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:56.743919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5f113875-80a4-4d33-90e4-14e1493cc938 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:56.762465 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5f113875-80a4-4d33-90e4-14e1493cc938 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1221 microversion: 2.1 time: 0.151322 Aug 27 03:30:56.779544 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 134/296] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:56 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:57.116851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.132687 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-afd6bfd0-1ef2-46f6-9752-12907251216f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.451578 Aug 27 03:30:57.139466 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 163/297] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:56 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:57.277512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-12130a84-ae0a-4b97-b12c-803875649bab req-b73360e2-f50c-421c-b843-6f58a8d831d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90527ef8-4d61-4bc5-8ecc-ed05837e0dc5", "name": "network-vif-plugged", "status": "completed", "tag": "81dbe444-5db9-4391-bed2-2330c577d434"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:57.279221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:30:57.279221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:30:57.289580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-12130a84-ae0a-4b97-b12c-803875649bab req-b73360e2-f50c-421c-b843-6f58a8d831d5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.290206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-12130a84-ae0a-4b97-b12c-803875649bab req-b73360e2-f50c-421c-b843-6f58a8d831d5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.304850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-12130a84-ae0a-4b97-b12c-803875649bab req-b73360e2-f50c-421c-b843-6f58a8d831d5 service nova] Creating event network-vif-plugged:81dbe444-5db9-4391-bed2-2330c577d434 for instance 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 on hv-cinder-80473 Aug 27 03:30:57.311044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-12130a84-ae0a-4b97-b12c-803875649bab req-b73360e2-f50c-421c-b843-6f58a8d831d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037559 Aug 27 03:30:57.312312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 135/298] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:30:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:57.478937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:57.481608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:57.500544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.501211 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.503171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.503624 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.596039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cf747eb2-d232-4661-830e-e54b9b7467d7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28181 microversion: 2.20 time: 0.118663 Aug 27 03:30:57.601361 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 164/299] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:57 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28181 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:57.649367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:57.651367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:57.668032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.669424 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.677726 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.678503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.781379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:57.782394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:57.813765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.815621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:57.818539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:57.824583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:58.044905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:58.058282 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4bba153d-a306-44de-8276-76cc4fc60b29 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1273 microversion: 2.1 time: 0.278408 Aug 27 03:30:58.060508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 165/300] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:57 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:58.071046 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a9c82eaf-3d39-4dba-ad76-51a2dcfb9ca0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28230 microversion: 2.1 time: 0.427878 Aug 27 03:30:58.072336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 136/301] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:57 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28230 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:58.159101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:58.159979 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:58.172204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:58.174804 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:58.178106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:58.181985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:58.483696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:58.501457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cfe30307-57d4-449f-ab87-9e9c581465c0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1318 microversion: 2.1 time: 0.346777 Aug 27 03:30:58.504395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 166/302] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:58 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:58.609138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:58.610133 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:58.632067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:58.632615 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:58.634449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:58.634890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:58.733386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0de7de9a-1987-4ac8-90e7-078054c56112 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28181 microversion: 2.20 time: 0.128140 Aug 27 03:30:58.734037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 137/303] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:58 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28181 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:59.081360 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:59.082082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:59.084557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:59.085806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:59.094627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.095106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.098538 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.099389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.100793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.103749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.103880 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.104389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.242019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c3b4fb01-2137-4720-9523-684c34004c84 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28262 microversion: 2.1 time: 0.163171 Aug 27 03:30:59.247459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 138/304] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:30:59 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:30:59.324303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:59.337065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-98aa0e58-df60-434f-8306-f94e577d86cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1279 microversion: 2.1 time: 0.259993 Aug 27 03:30:59.339665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 167/305] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:59 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:59.516181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:59.517035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:59.532676 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.533471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.534492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.535183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.746382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:59.747342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:30:59.756227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.758312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.759278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:30:59.760889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:30:59.961395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ef13f3e0-093c-45f6-b1f1-cbd8caaa1d55 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28470 microversion: 2.20 time: 0.219331 Aug 27 03:30:59.963077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 168/306] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:30:59 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:31:00.173403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:00.184231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a2e76924-367c-489c-a84e-3975fec1bb41 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1507 microversion: 2.1 time: 0.672915 Aug 27 03:31:00.185508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 139/307] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:30:59 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:00.204178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "035ddf83-f10a-486e-8dd2-de074b8c3979"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:00.205600 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.213307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.213997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.215002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.215615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.257169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:00.258602 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.266848 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.267675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.269075 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.269751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.339733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Invalid volume: volume 035ddf83-f10a-486e-8dd2-de074b8c3979 is already attached to instances: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 Aug 27 03:31:00.340875 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 400 to user: Invalid volume: volume 035ddf83-f10a-486e-8dd2-de074b8c3979 is already attached to instances: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:00.342209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-53330158-082c-4c55-9292-1c1504f57ff1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143476 Aug 27 03:31:00.358567 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 169/308] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:00 2021] POST /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:31:00.373300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.374248 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.383205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.386438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ae5e141c-d559-43a4-b70c-0a5286647719 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28521 microversion: 2.1 time: 0.133316 Aug 27 03:31:00.388202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 140/309] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:00 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:00.390853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.391725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.392157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.443144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.444354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.451895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.452581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.453505 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.454076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.697750 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'services' on Instance uuid 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:31:00.790031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:00.802225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-87ea6ffb-f041-4e48-a888-e632caabc3b0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.437400 Aug 27 03:31:00.802225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 170/310] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:00 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:00.858028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-52bcde08-1f39-464a-8e05-fe1fb1a2ab07 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments/035ddf83-f10a-486e-8dd2-de074b8c3979" status: 202 len: 0 microversion: 2.1 time: 0.418778 Aug 27 03:31:00.860031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 141/311] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:31:00 2021] DELETE /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments/035ddf83-f10a-486e-8dd2-de074b8c3979 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:00.869776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.871217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.887689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.888283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.889292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.890123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.932743 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fe13b87d-3801-406f-b667-80a842c3b999 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068660 Aug 27 03:31:00.933569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 171/312] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:00 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:00.976732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:00.978156 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:00.990030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.990824 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:00.991794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:00.992415 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:01.017048 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-945c6385-e447-47a3-a64f-fdf7946d5355 req-b3e0bd10-c7c0-4525-b276-077e8ca5475e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95f90b2-f020-440a-81cf-5e339f032c8b", "tag": "09d98d1e-1fdd-4a75-b401-02f9b781896d"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:01.019109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:01.019109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:01.043796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-945c6385-e447-47a3-a64f-fdf7946d5355 req-b3e0bd10-c7c0-4525-b276-077e8ca5475e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:01.048346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-945c6385-e447-47a3-a64f-fdf7946d5355 req-b3e0bd10-c7c0-4525-b276-077e8ca5475e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:01.089339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-945c6385-e447-47a3-a64f-fdf7946d5355 req-b3e0bd10-c7c0-4525-b276-077e8ca5475e service nova] Creating event network-changed:09d98d1e-1fdd-4a75-b401-02f9b781896d for instance f95f90b2-f020-440a-81cf-5e339f032c8b on hv-cinder-80473 Aug 27 03:31:01.095908 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-945c6385-e447-47a3-a64f-fdf7946d5355 req-b3e0bd10-c7c0-4525-b276-077e8ca5475e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091428 Aug 27 03:31:01.097423 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 172/313] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:01.269988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-0a870463-d081-4d46-a949-8c2694303062 req-9f7591fd-794e-471f-ba84-2bedc5a49663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812b109c-444e-4971-99e3-59d4d3993ff3", "tag": "3a9cae7d-f3bd-41ea-856e-afad4fd8420a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:01.271884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:01.271884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:01.285120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-0a870463-d081-4d46-a949-8c2694303062 req-9f7591fd-794e-471f-ba84-2bedc5a49663 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:01.285559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-0a870463-d081-4d46-a949-8c2694303062 req-9f7591fd-794e-471f-ba84-2bedc5a49663 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:01.313582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-0a870463-d081-4d46-a949-8c2694303062 req-9f7591fd-794e-471f-ba84-2bedc5a49663 service nova] Creating event network-changed:3a9cae7d-f3bd-41ea-856e-afad4fd8420a for instance 812b109c-444e-4971-99e3-59d4d3993ff3 on hv-cinder-80473 Aug 27 03:31:01.322874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-0a870463-d081-4d46-a949-8c2694303062 req-9f7591fd-794e-471f-ba84-2bedc5a49663 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056695 Aug 27 03:31:01.328653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 173/314] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:01.400937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:01.404905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:01.420787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:01.422974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:01.426655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:01.430682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:03.535948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4228e16a-1164-46bb-bc8b-3cdeac36609d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28521 microversion: 2.1 time: 2.140091 Aug 27 03:31:03.537356 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 174/315] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:01 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28521 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:03.542027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:03.542473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:03.565343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:03.568922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:03.570020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:03.572083 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:03.591694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7d1793c0-1c4f-4dcc-9180-6cad1680a4fa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 2.620098 Aug 27 03:31:03.592301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 142/316] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:00 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:03.602987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:03.604035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:03.636141 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:03.636628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:03.639248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:03.640287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:03.713941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0291971d-e9ef-4306-b9e5-8f176bb33c21 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116580 Aug 27 03:31:03.714527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 143/317] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:03 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:03.999265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:04.010101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1f31b09f-8c98-4dc9-9f1b-5c11fa6d05a6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.472057 Aug 27 03:31:04.010943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 175/318] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:03 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:04.550171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:04.551070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:04.560724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:04.561155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:04.561979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:04.562369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:04.604504 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:04.605618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:04.612718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:04.613251 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:04.614948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:04.614948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.872181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9e919596-c0cd-4734-a3e0-64d40cfc5a58 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28689 microversion: 2.1 time: 2.325419 Aug 27 03:31:06.873397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 144/319] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:04 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28689 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:06.878724 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f6ff0886-3ccc-4f99-bba8-618da444bcc9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 2.277888 Aug 27 03:31:06.879420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 176/320] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:04 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:31:06.887028 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:06.888152 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:06.900165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.900878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.902086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.902782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.954337 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-97aa38a5-73c1-46dd-a55a-a9a52b7c611d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073658 Aug 27 03:31:06.955672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 177/321] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:06 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:06.960299 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:06.961103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:06.967077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.967763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:06.968679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:06.977837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:07.157433 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Action: 'create', calling method: .version_select at 0x7f6cfc492b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-831302725"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:07.186762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for project 90c43de7a6384b82b35f14a762da5d37. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:07.191552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for user e7811e8849c74b2b9aa9182bec90fc7d and project 90c43de7a6384b82b35f14a762da5d37. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:07.245245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:07.254887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-be40d999-989b-4ef1-92a8-ec60d02a85df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.297700 Aug 27 03:31:07.255846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 178/322] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:06 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:07.408770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for project 90c43de7a6384b82b35f14a762da5d37. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:07.416048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for user e7811e8849c74b2b9aa9182bec90fc7d and project 90c43de7a6384b82b35f14a762da5d37. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:07.434190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-66585ac4-8658-449a-987a-d809f75e5b5c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.559373 Aug 27 03:31:07.440858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 145/323] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Aug 27 03:31:06 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:07.885247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:07.889229 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:07.892970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:07.894704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:07.898481 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:07.899300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:07.900330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:07.900951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:07.912153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:07.913229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:07.914438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:07.915106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.019837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1b2d9e26-f8e9-4529-bfe2-7af56648144c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 0.132717 Aug 27 03:31:08.020665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 146/324] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:07 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:08.032926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cad8616a-558e-4753-8939-d3860f2a78a8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28689 microversion: 2.1 time: 0.151083 Aug 27 03:31:08.033971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 179/325] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:07 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:31:08.039899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.041856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:08.049754 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.050196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.050961 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.051662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.093692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-593b78b5-aa4c-4889-96c2-e70d44066337 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071533 Aug 27 03:31:08.094531 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 147/326] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:08 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:31:08.273939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.274634 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:08.290698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.291136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.306119 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.307041 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.316642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1276582583", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:08.428247 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] validate_networks() for [('a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:08.535000 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:08.544068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f61078dd-5146-4dc4-b0ec-80313df07c70 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.275496 Aug 27 03:31:08.544855 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 180/327] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:08 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:08.867745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:08.868163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:08.868687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:08.869248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:08.869656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:08.880677 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.881125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:08.881960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:08.882417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.032715 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:09.034004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:09.040950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.041964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.043160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.044061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.065366 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:09.070228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for user b0959c5e5b1c49a9b5395f90360ce934 and project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:09.083266 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:09.085869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:09.138864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ffecf487-7a1d-44a3-9220-d7e3d769de6c tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826206 Aug 27 03:31:09.139980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 148/328] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:31:09.143786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e7b113e2-9f6c-4dca-8ef3-a7f41464391f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 0.115180 Aug 27 03:31:09.148466 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 181/329] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:09 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:09.151282 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:09.152289 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:09.154278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-47b80a9a-bc01-44ea-ac2a-94c299e618de tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:09.155119 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-47b80a9a-bc01-44ea-ac2a-94c299e618de tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:09.158616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.159059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.159892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.160326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.215204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-47b80a9a-bc01-44ea-ac2a-94c299e618de tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:09.223800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-47b80a9a-bc01-44ea-ac2a-94c299e618de tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1218 microversion: 2.1 time: 0.073399 Aug 27 03:31:09.224801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 182/330] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:09 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:09.229381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-753bc2dc-4626-4cd3-bc97-4203bc506139 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28689 microversion: 2.1 time: 0.088049 Aug 27 03:31:09.233341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 149/331] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:09 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28689 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:09.561292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:09.561895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:09.571065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.571541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.572505 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:09.573091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:09.737652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:09.748074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-03fc14ff-08e3-4e52-a5c4-71275865cd31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.190376 Aug 27 03:31:09.748646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 183/332] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:09 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:10.156809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:10.158486 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:10.167221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.168186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.168990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.169659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.240492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:10.241522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:10.250044 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.250746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.251602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.252111 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.275203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7a874dc9-b636-473d-a3cc-a2607783cb31 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 0.122289 Aug 27 03:31:10.279487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 150/333] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:10 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:10.281602 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:10.282293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:10.292162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.293397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.294761 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.295178 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.326946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5470af02-dbbb-40e9-b75f-87c7c6f18037 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28689 microversion: 2.1 time: 0.090374 Aug 27 03:31:10.331959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 184/334] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:10 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28689 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:31:10.390926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:10.400219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2cd49ccd-7e36-44bc-9c50-5f80fcdeb1ac tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1270 microversion: 2.1 time: 0.121776 Aug 27 03:31:10.401025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 151/335] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:10 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:10.766021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:10.770837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:10.781027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.781855 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.783016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:10.783817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:10.985525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:11.011264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-61e484ae-55c1-44d7-825d-787bb23ac595 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.250444 Aug 27 03:31:11.011900 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 185/336] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:10 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:11.289477 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:11.291164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:11.299164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.299872 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.300805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.301414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.346656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:11.347664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:11.354880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.355411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.356412 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.356919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.390419 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9c46ba52-82e1-46d9-b8eb-9d08a180b501 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28638 microversion: 2.20 time: 0.106231 Aug 27 03:31:11.391046 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 152/337] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:11 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28638 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:11.418165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:11.418948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:11.426136 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.427623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.428624 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:11.429550 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:11.469960 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b02708a0-bd04-4a81-aff4-ddd33e07f61c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 28689 microversion: 2.1 time: 0.133551 Aug 27 03:31:11.471966 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 186/338] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:11 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 28689 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:11.626950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:11.640999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a67aea44-d40b-448e-8a10-91f6ffefb3d5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.227021 Aug 27 03:31:11.641571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 153/339] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:11 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:12.015654 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-88ff3c32-d06b-402c-b269-06623bed411b req-4be7a167-231a-4236-854a-726b9ad8f818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bae22e-2148-4695-89b6-0ca9fe64214e", "tag": "9f3da0a3-b185-45ff-b4d2-014e05b788f5"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:12.016577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:12.016577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:12.029315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.029923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.034097 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-88ff3c32-d06b-402c-b269-06623bed411b req-4be7a167-231a-4236-854a-726b9ad8f818 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.034542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-88ff3c32-d06b-402c-b269-06623bed411b req-4be7a167-231a-4236-854a-726b9ad8f818 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.036333 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.036600 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.037556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.038126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.063452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-88ff3c32-d06b-402c-b269-06623bed411b req-4be7a167-231a-4236-854a-726b9ad8f818 service nova] Creating event network-changed:9f3da0a3-b185-45ff-b4d2-014e05b788f5 for instance 33bae22e-2148-4695-89b6-0ca9fe64214e on hv-cinder-80473 Aug 27 03:31:12.069573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-88ff3c32-d06b-402c-b269-06623bed411b req-4be7a167-231a-4236-854a-726b9ad8f818 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060569 Aug 27 03:31:12.070460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 187/340] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:12.199749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:12.208791 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-22e40af9-2160-48fa-ae70-ad0a050dabf4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.183584 Aug 27 03:31:12.209745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 154/341] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:12 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:12.403400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:12.404389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.417499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.417951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.418733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.419157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.481918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:12.483483 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.495942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.496679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.498509 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.499094 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.566750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fe033788-bc02-4992-bb8b-dfbe85ba2284 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 28733 microversion: 2.20 time: 0.167438 Aug 27 03:31:12.567626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 188/342] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:12 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 28733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:12.648452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1ca46d5e-7c7e-4ea7-92fa-84013f49ed07 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 29021 microversion: 2.1 time: 0.169704 Aug 27 03:31:12.649513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 155/343] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:12 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 29021 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:12.667656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.669049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:12.676022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.676971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.678158 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:12.679929 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:12.900692 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:12.912361 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dae0335f-3c1d-44c7-9218-26f14dc2ee57 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.257690 Aug 27 03:31:12.913284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 189/344] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:12 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:13.232021 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:13.235230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:13.243166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.244092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.245480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.246009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.434697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:13.443745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2e8ff2f0-c8ac-4de9-a39b-46d396a4c8c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.221670 Aug 27 03:31:13.444331 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 156/345] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:13 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:13.581630 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:13.583913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:13.593329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.600544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.601878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.602509 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.681012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:13.681973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:13.709735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.710170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.710946 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.726709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.854582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-df48fc19-9e59-49ec-acf7-d2aadac0f3d2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 29724 microversion: 2.1 time: 0.194658 Aug 27 03:31:13.859519 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 157/346] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:13 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 29724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:13.933062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:13.934118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:13.944557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.944992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.945936 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:13.946669 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:13.989104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8ffd76f5-6fa7-4943-93b6-346d887ff53a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 30102 microversion: 2.20 time: 0.414017 Aug 27 03:31:13.990380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 190/347] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:13 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 30102 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:14.089951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.094697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dd093b4e-63eb-406e-87f2-96c529d551a5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.167639 Aug 27 03:31:14.095268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 158/348] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:13 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:14.462238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.462928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:14.469612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.470053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:14.470817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.471241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:14.610942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.622457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-635d712a-d8b9-4a96-8d92-78ac472de4d0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.165952 Aug 27 03:31:14.623051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 191/349] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:14 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:14.868477 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:14.873298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:14.885617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.886309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:14.887629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:14.888242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.003070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:15.003318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5c59d0e1-70fa-40de-9948-493b706118aa tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 30823 microversion: 2.1 time: 0.139861 Aug 27 03:31:15.007742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 159/350] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:14 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 30823 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:15.007997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:15.011639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.012155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.013293 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.013903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.105292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-81effa40-f8ef-4ace-a64a-39b6dbb19128 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 31166 microversion: 2.20 time: 0.106568 Aug 27 03:31:15.111969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 192/351] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:14 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 31166 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:15.115163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.116017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:15.122544 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.122984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.123982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.124410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.269347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.277389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-28ab7a6b-ce10-4d7f-bcc0-0533154ecafa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.169098 Aug 27 03:31:15.277949 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 160/352] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:15 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:15.641021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.641872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:15.648711 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.649157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.650171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.650586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.781087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.789168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cdde43ff-cbdb-441b-8d03-856083e1cd54 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.152717 Aug 27 03:31:15.789719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 193/353] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:15 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:15.837216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-31f76e6b-f717-499e-83bb-fbcc6fd662be req-bfa8b96b-f466-4390-a29b-5945c1b0a552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95f90b2-f020-440a-81cf-5e339f032c8b", "name": "network-vif-plugged", "status": "completed", "tag": "09d98d1e-1fdd-4a75-b401-02f9b781896d"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:15.838947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:15.838947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:31:15.846588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-31f76e6b-f717-499e-83bb-fbcc6fd662be req-bfa8b96b-f466-4390-a29b-5945c1b0a552 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:15.847049 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-31f76e6b-f717-499e-83bb-fbcc6fd662be req-bfa8b96b-f466-4390-a29b-5945c1b0a552 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:15.858471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-31f76e6b-f717-499e-83bb-fbcc6fd662be req-bfa8b96b-f466-4390-a29b-5945c1b0a552 service nova] Creating event network-vif-plugged:09d98d1e-1fdd-4a75-b401-02f9b781896d for instance f95f90b2-f020-440a-81cf-5e339f032c8b on hv-cinder-80473 Aug 27 03:31:15.863294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-31f76e6b-f717-499e-83bb-fbcc6fd662be req-bfa8b96b-f466-4390-a29b-5945c1b0a552 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Aug 27 03:31:15.864272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 161/354] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:16.014726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:16.015775 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.021927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.022572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.023640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.024068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.119167 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c756e05a-e134-40d8-b79d-8baea9abf590 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 31924 microversion: 2.1 time: 0.108224 Aug 27 03:31:16.119934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 194/355] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:16 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 31924 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:31:16.124026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:16.125022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.131283 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.131756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.132525 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.132947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.294879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.295722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.302564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.302999 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.303797 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.304525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.433318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:16.440182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b7a2b2b0-0c1c-4343-9546-a601d30b4e53 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 32279 microversion: 2.20 time: 0.321059 Aug 27 03:31:16.440817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 162/356] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:16 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 32279 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:16.441468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fd390b65-f137-449e-9e5a-7d0ffb5e099d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.150868 Aug 27 03:31:16.442625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 195/357] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:16 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:16.668875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-399885037", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "4f81df06-e296-4035-a97c-b43d344f0b90"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:16.722811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] validate_networks() for [('4f81df06-e296-4035-a97c-b43d344f0b90', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:16.806312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.806872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:16.814874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.815324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.816133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.816590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.026593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.034746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-225f6943-6398-4ed6-817b-f0ba1e6e908d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.232418 Aug 27 03:31:17.040255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 196/358] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:16 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:17.131589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:17.132505 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.137833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:17.138324 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:17.138706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:17.139211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:17.139671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:17.140310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.140927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.141709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.142162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.149452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.149897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.150697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.151145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.168201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Getting quotas for project 7dd6a8224c1149f6a978d9174fa5a7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:17.173160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Getting quotas for user 6faa1a83294641068232fe1b173af45e and project 7dd6a8224c1149f6a978d9174fa5a7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:17.184779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:17.187182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:17.235756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fadda664-8cbe-4a44-a350-b79ca68b63af tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568347 Aug 27 03:31:17.236650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 163/359] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:17.248173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d61f4603-5e2a-4943-8d24-56412f54b1ed tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.248817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d61f4603-5e2a-4943-8d24-56412f54b1ed tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.250616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6cdd9ce9-1df1-4353-9837-aca65c2dd8e7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 32536 microversion: 2.1 time: 0.122657 Aug 27 03:31:17.255826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 197/360] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:17 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 32536 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:17.304935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d61f4603-5e2a-4943-8d24-56412f54b1ed tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.312100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d61f4603-5e2a-4943-8d24-56412f54b1ed tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1218 microversion: 2.1 time: 0.067586 Aug 27 03:31:17.312685 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 164/361] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:17 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.453142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:17.454432 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.459517 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.460678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:17.468008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.468756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.469713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.470282 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.472347 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.473368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.474205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.474639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.591993 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9650c0d4-a5e6-4398-a696-cafa82c8e123 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 32742 microversion: 2.20 time: 0.142871 Aug 27 03:31:17.593494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 198/362] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:17 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 32742 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:17.632253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.644462 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-caeb35eb-31a3-4894-80e6-ac05abcfc116 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.189573 Aug 27 03:31:17.652285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 165/363] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:17 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.880330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b109c-444e-4971-99e3-59d4d3993ff3", "name": "network-vif-plugged", "status": "completed", "tag": "3a9cae7d-f3bd-41ea-856e-afad4fd8420a"}, {"server_uuid": "33bae22e-2148-4695-89b6-0ca9fe64214e", "name": "network-vif-plugged", "status": "completed", "tag": "9f3da0a3-b185-45ff-b4d2-014e05b788f5"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:17.882100 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:17.882100 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:17.891110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.891664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.905187 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] Creating event network-vif-plugged:3a9cae7d-f3bd-41ea-856e-afad4fd8420a for instance 812b109c-444e-4971-99e3-59d4d3993ff3 on hv-cinder-80473 Aug 27 03:31:17.905810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] Creating event network-vif-plugged:9f3da0a3-b185-45ff-b4d2-014e05b788f5 for instance 33bae22e-2148-4695-89b6-0ca9fe64214e on hv-cinder-80473 Aug 27 03:31:17.912501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-58a9d4c7-5881-4a5a-bb67-b4e19df1830b req-16124426-13db-46bb-a7e9-0e09b0feac82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036652 Aug 27 03:31:17.913465 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 199/364] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:18.055683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.056277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.062493 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.062930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.063928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.064702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.228496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.236430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5528e053-77c2-4092-ac0d-7ec745656bae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.184805 Aug 27 03:31:18.237002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 166/365] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.264805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:18.265793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.272291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.272731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.273482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.273906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.331429 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.331429 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.339939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.340378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.341142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.341603 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.405391 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.412929 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3038b2b1-490a-44f2-b390-80b32f237aa7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1270 microversion: 2.1 time: 0.086588 Aug 27 03:31:18.413489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 167/366] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.605800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:18.607002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.615970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.616413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.617210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.617632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.844929 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d78dff36-8eb0-4343-bf3e-fc51d58aeea6 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 34178 microversion: 2.1 time: 0.583880 Aug 27 03:31:18.845473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 200/367] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:18 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 34178 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:18.850613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.851425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:18.858328 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.858802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.859589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:18.860058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:18.862399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b007795c-1058-40a4-8cb6-fd37db66ecc8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 33298 microversion: 2.20 time: 0.260368 Aug 27 03:31:18.863059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 168/368] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:18 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 33298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:19.006326 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.014054 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-26d38e38-66e6-482e-9391-9f22f3a07a94 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.167410 Aug 27 03:31:19.014590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 201/369] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:18 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.255382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.256210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.263589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.264140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.264953 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.265372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.436437 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.437550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.444569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.445164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.446100 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.446658 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.531312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.539458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b7ed7cd5-cd8a-46ce-8553-c872ab865a2f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1276 microversion: 2.1 time: 0.107030 Aug 27 03:31:19.540034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 202/370] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.575431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.583378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b4e6e918-961c-44ee-aa67-14ba8d14e6d8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1321 microversion: 2.1 time: 0.332343 Aug 27 03:31:19.583968 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 169/371] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:19 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.857503 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:19.858440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.866098 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.866694 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.867941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.868443 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.875217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:19.876601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:19.884554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.885134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:19.885995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:19.886432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.035772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-76f36df6-c899-4d2e-9547-f5b00c1ace20 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 34417 microversion: 2.1 time: 0.181797 Aug 27 03:31:20.036912 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 203/372] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:19 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 34417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:20.042622 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.043318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.050173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.050623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.051803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.052240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.103742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2361e0a4-782e-4669-a2fd-6c50ac75ed6f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 33608 microversion: 2.20 time: 0.232664 Aug 27 03:31:20.107202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 170/373] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:19 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 33608 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:20.297698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.306353 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5a77aca7-1f5f-4957-a314-544be1b818f9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1318 microversion: 2.1 time: 0.268106 Aug 27 03:31:20.306949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 204/374] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:20.565867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.566582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.577929 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.578383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.579155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.579610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.601866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.602704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.609111 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.609737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.610500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.610926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.838772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.850760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c0d838da-9f06-4b81-ad0d-40edc10b6baf tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.288867 Aug 27 03:31:20.851733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 171/375] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:20.866992 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.874500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-425be765-893a-4243-82c3-3472d22ae23a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1515 microversion: 2.1 time: 0.277257 Aug 27 03:31:20.875112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 205/376] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:20 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:20.895997 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:20.896891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:20.906103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-dab81941-4f8a-45a4-a07e-7a770b2cbf82 req-847482de-7e82-4dbf-838e-c340dff6aac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266886ac-4054-4dc4-afe2-5737087f1b90", "tag": "1ef36c23-9824-4f9d-a2de-efeb158b70c0"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:20.908179 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:20.908179 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:20.914534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.919334 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-dab81941-4f8a-45a4-a07e-7a770b2cbf82 req-847482de-7e82-4dbf-838e-c340dff6aac4 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.920144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.921246 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:20.921901 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.925324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-dab81941-4f8a-45a4-a07e-7a770b2cbf82 req-847482de-7e82-4dbf-838e-c340dff6aac4 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:20.945886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-dab81941-4f8a-45a4-a07e-7a770b2cbf82 req-847482de-7e82-4dbf-838e-c340dff6aac4 service nova] Creating event network-changed:1ef36c23-9824-4f9d-a2de-efeb158b70c0 for instance 266886ac-4054-4dc4-afe2-5737087f1b90 on hv-cinder-80473 Aug 27 03:31:20.951001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-dab81941-4f8a-45a4-a07e-7a770b2cbf82 req-847482de-7e82-4dbf-838e-c340dff6aac4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048587 Aug 27 03:31:20.951636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 206/377] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:20.952243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lazy-loading 'flavor' on Instance uuid 812b109c-444e-4971-99e3-59d4d3993ff3 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:31:21.051276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:21.053390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.061321 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.061782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.062541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.062958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.084635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4db477e8-503f-49e8-96be-8495380ed9ac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3/action" status: 200 len: 32 microversion: 2.1 time: 0.194532 Aug 27 03:31:21.086300 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 172/378] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:20 2021] POST /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:31:21.095160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.096151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.105652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.106390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.107579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.108215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.189716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d7f0ee04-529e-4665-a1f9-30303d2a6085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 34682 microversion: 2.1 time: 0.144386 Aug 27 03:31:21.190897 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 207/379] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:21 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 34682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:31:21.196998 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:21.198191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.207257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.208082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.208934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.209523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.330473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-febec9e2-d039-463f-92f6-bc308bb4e495 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 34038 microversion: 2.20 time: 0.137564 Aug 27 03:31:21.331550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 208/380] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:21 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 34038 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:21.337305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.338004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.344862 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.345304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.346112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.346546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.472211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.483788 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4ec2fed6-39d5-4061-a051-8f7d447abbd8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.392790 Aug 27 03:31:21.484652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 173/381] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:21.669433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.678416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a5548247-8605-4f75-9bb6-01e776856796 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1508 microversion: 2.1 time: 0.345314 Aug 27 03:31:21.679318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 209/382] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.869281 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.870744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:21.877309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.877742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:21.878965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:21.879127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.136034 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.146179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-342f145b-b0f6-48c5-abb2-da46e664fe55 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.281643 Aug 27 03:31:22.146928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 174/383] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:21 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.202824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:22.203787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.210094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.210559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.211333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.211780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.349224 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:22.350189 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.356635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.357083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.357856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.358283 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.425305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8a75ec26-f3b2-4b00-a25e-e8874e47fd4d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 35052 microversion: 2.1 time: 0.226117 Aug 27 03:31:22.426590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 210/384] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:22 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 35052 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:22.502080 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.502871 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:22.509946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.510385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.511117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:22.511602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:22.541883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1050dd28-2da0-4378-990c-23e3f1d6d99b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 34486 microversion: 2.20 time: 0.196468 Aug 27 03:31:22.544871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 175/385] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:22 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 34486 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:22.644951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.654858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-035a1156-b768-42c6-a14b-ad9cfe5ffeac tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.156677 Aug 27 03:31:22.655675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 211/386] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:22 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.040922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db40d876-0658-4e7e-b247-76a717ceeeb2"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:23.043642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.050958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.051432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.052232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.052702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.162844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.163625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.169755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.170274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.171039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.171525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.299833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.309257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44606916-7dd5-4b9a-b991-c66a4902d8d1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.150621 Aug 27 03:31:23.310179 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 212/387] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:23 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.339194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a5c6b0a8-ad5b-42c2-a90a-f0024809eea5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303528 Aug 27 03:31:23.339910 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 176/388] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:23 2021] POST /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:23.439154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:23.440173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.446747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.447188 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.447998 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.448424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.555090 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:23.556240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.563498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.564042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.564878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.565370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.567458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0b118cf3-0fce-4e8a-b3e7-3d20e6a6c3b2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 35898 microversion: 2.1 time: 0.132190 Aug 27 03:31:23.568091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 213/389] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:23 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 35898 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:23.673553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.674228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:23.676064 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-29b574fb-ade3-4335-a7dd-2e9aa7402860 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 35610 microversion: 2.20 time: 0.125213 Aug 27 03:31:23.676752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 177/390] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:23 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 35610 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:31:23.681788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.682239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.683052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:23.683514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:23.818331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.826143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bc923470-9326-45d5-977a-b8b358270727 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.156779 Aug 27 03:31:23.826714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 214/391] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:23 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:24.328229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.328787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.336185 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.337418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.338228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.338659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.469855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.477060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-37954898-6868-4bc2-8c4c-9a35f50d65cd tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.153248 Aug 27 03:31:24.477766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 178/392] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.584980 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:24.586221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.596614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.597317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.598504 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.599196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.688765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:24.690062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.695753 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1cf92372-bbf6-46ed-93d1-9e3c0fa814f7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 36550 microversion: 2.1 time: 0.117451 Aug 27 03:31:24.697874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 215/393] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:24 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 36550 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:24.698073 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.698471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.699811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.700503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.806077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8f9c4e3f-84d8-4267-b5f9-8f988bc4492c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 36273 microversion: 2.20 time: 0.120807 Aug 27 03:31:24.806752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 179/394] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:24 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 36273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:24.852685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.853266 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:24.860252 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.860691 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.861450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:24.861863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:24.992344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.001113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2340e2b9-e939-4c3c-96ef-f18dea0a498f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.155092 Aug 27 03:31:25.001685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 216/395] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:24 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.495952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.497346 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.504350 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.504817 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.505638 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.506068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.634762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.642778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-40a00820-a7a4-48c1-907e-59992cef259c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.152127 Aug 27 03:31:25.643385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 180/396] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:25 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.709241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:25.710226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.717066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.717511 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.718290 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.718717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.820265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:25.822354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:25.826496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-361ea804-9cf3-4764-ad0e-67754291156c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 37413 microversion: 2.1 time: 0.120332 Aug 27 03:31:25.830268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 217/397] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:25 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 37413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:25.830405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.830891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.832250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:25.833081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:25.947509 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4d185acb-969e-455b-b690-c80278a7ddae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 36898 microversion: 2.20 time: 0.132412 Aug 27 03:31:25.948197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 181/398] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:25 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 36898 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:31:26.019682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.020270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.027784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.028225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.028985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.029434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.170017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.183219 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1097c98f-d7bb-45fb-b61a-54668cc74fce tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.167435 Aug 27 03:31:26.184059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 218/399] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:26 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.667404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.668527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.680133 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.681010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.681884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.682307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.824201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.831554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-95e43674-2316-41c1-ba64-d5a786ff7d31 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.172929 Aug 27 03:31:26.832103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 182/400] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:26 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.837953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:26.838882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.844955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.845417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.846189 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.846618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.961596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:26.962475 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:26.968964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.969405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.970159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:26.970581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:26.982984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-367e3287-54af-4b1b-b9d4-c94a9f91114e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 37953 microversion: 2.1 time: 0.148541 Aug 27 03:31:26.983911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 219/401] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:26 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 37953 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:27.101709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f14c2623-e978-47d6-b028-ffba11bd101d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 37613 microversion: 2.20 time: 0.143378 Aug 27 03:31:27.102569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 183/402] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:26 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 37613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:27.201090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.201781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:27.208642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.209096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.209865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.210291 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.333602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.341183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-786f5d67-0ce9-4167-a835-bbaaf9cf7bd0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.144050 Aug 27 03:31:27.341740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 220/403] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:27 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:27.850337 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.851259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:27.860547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.861184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.862064 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:27.862494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:27.995595 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:27.996514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.002774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.003268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.004079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.004859 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.014018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.022076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-82690001-e3eb-49c7-8c06-7efd2c1287f4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.176407 Aug 27 03:31:28.022630 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 184/404] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:27 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.119090 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:28.120032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.122683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-beb45694-f1cc-4f70-8a28-5f6b4965b101 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 38167 microversion: 2.1 time: 0.130959 Aug 27 03:31:28.125034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 221/405] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:27 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 38167 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:28.126839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.127285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.128095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.128571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.223555 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8d0dd028-1666-4059-9f87-bdd6242254d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 38127 microversion: 2.20 time: 0.109963 Aug 27 03:31:28.224647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 185/406] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:28 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 38127 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:31:28.361327 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.362214 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:28.370805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.371146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.372172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:28.372597 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:28.501554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.512477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-794ff1cf-5b33-41c2-8751-0dfc51b1c0e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.155630 Aug 27 03:31:28.513046 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 222/407] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:28 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.044534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.045278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.052430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.052875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.053633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.054418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.134967 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:29.136131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.142500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.142969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.143765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.144185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.186235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.193768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-52fabf7d-010b-4782-b1d0-165a1d6e198e tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.154855 Aug 27 03:31:29.194446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 186/408] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.231012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-517343d5-a97d-4e25-b5ba-08f8ae7eebe2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 38167 microversion: 2.1 time: 0.100128 Aug 27 03:31:29.231817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 223/409] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:29 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 38167 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:29.238518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:29.239918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.249940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.250520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.251451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.251891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.342021 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f860c620-03bc-4929-8bd9-40df8b42f53c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 38127 microversion: 2.20 time: 0.107657 Aug 27 03:31:29.342888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 187/410] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:29 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 38127 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:29.531796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.532472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:29.538982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.539453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.540206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.540623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.735236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-90695a1f-96ee-4d34-b29a-561879648118 req-664cce05-247b-4ec1-aafb-20c9f8f57cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266886ac-4054-4dc4-afe2-5737087f1b90", "name": "network-vif-plugged", "status": "completed", "tag": "1ef36c23-9824-4f9d-a2de-efeb158b70c0"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:29.736887 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:29.736887 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:31:29.752050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-90695a1f-96ee-4d34-b29a-561879648118 req-664cce05-247b-4ec1-aafb-20c9f8f57cb6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:29.752481 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-90695a1f-96ee-4d34-b29a-561879648118 req-664cce05-247b-4ec1-aafb-20c9f8f57cb6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:29.768651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-90695a1f-96ee-4d34-b29a-561879648118 req-664cce05-247b-4ec1-aafb-20c9f8f57cb6 service nova] Creating event network-vif-plugged:1ef36c23-9824-4f9d-a2de-efeb158b70c0 for instance 266886ac-4054-4dc4-afe2-5737087f1b90 on hv-cinder-80473 Aug 27 03:31:29.779867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-90695a1f-96ee-4d34-b29a-561879648118 req-664cce05-247b-4ec1-aafb-20c9f8f57cb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042431 Aug 27 03:31:29.791751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 188/411] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:29.909027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.918349 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-96100fd8-a6a3-4737-a937-f195d0e06644 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.390673 Aug 27 03:31:29.919162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 224/412] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:29 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.216713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.217576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.227194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.227915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.229810 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.230513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.244742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:30.245492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.251911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.252348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.253112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.253538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.358116 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.366102 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3f3a9ad4-f393-4f45-8d7e-295ca9d1697f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.156013 Aug 27 03:31:30.366670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 189/413] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.371409 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:30.373730 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.378108 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ef26e747-23f7-43e5-a379-4f7ad601a7be tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 38167 microversion: 2.1 time: 0.138053 Aug 27 03:31:30.378766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 225/414] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:30 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 38167 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:30.380816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.381267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.382125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.382570 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.480454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f179b238-b52d-41bb-9989-12c84cf5226e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 38127 microversion: 2.20 time: 0.112288 Aug 27 03:31:30.480999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 190/415] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:30 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 38127 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:30.906615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db40d876-0658-4e7e-b247-76a717ceeeb2"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:30.907760 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.914407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.914850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.915640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.916035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.937170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.937868 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:30.945282 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.945805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.946583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:30.947043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:30.997711 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Invalid volume: volume db40d876-0658-4e7e-b247-76a717ceeeb2 is already attached to instances: 33bae22e-2148-4695-89b6-0ca9fe64214e Aug 27 03:31:30.998301 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 400 to user: Invalid volume: volume db40d876-0658-4e7e-b247-76a717ceeeb2 is already attached to instances: 33bae22e-2148-4695-89b6-0ca9fe64214e {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:31:30.999184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d8dd6901-3d05-4c51-b15d-9af4bc742021 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096796 Aug 27 03:31:30.999769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 226/416] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:30 2021] POST /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:31:31.064756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.065241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.071212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.071685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.072538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.073218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.075596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.083212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e04190a5-1285-416d-9bfb-14d3941378df tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.150960 Aug 27 03:31:31.083829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 191/417] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:30 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.203425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'services' on Instance uuid 33bae22e-2148-4695-89b6-0ca9fe64214e {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:31:31.324937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-37ca3635-fc94-4af3-80ff-68282bb646c6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments/db40d876-0658-4e7e-b247-76a717ceeeb2" status: 202 len: 0 microversion: 2.1 time: 0.263778 Aug 27 03:31:31.325608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 227/418] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:31:31 2021] DELETE /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments/db40d876-0658-4e7e-b247-76a717ceeeb2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:31.334256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.335230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.343198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.343679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.344460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.344883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.376883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-edc12681-666c-40df-b712-27a8278e41d3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Aug 27 03:31:31.378389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 192/419] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:31.384004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.384694 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.390135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:31.391367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.391509 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.391976 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.392744 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.393349 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.397706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.398140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.398911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.399337 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.498575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7d2e6cf9-8a18-4b93-948b-42ef9357633e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 200 len: 38298 microversion: 2.1 time: 0.112098 Aug 27 03:31:31.499223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 193/420] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:31 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 38298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:31.504260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:31.505233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.511804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.512234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.513012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.513440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.521453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.528936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-59d0e71e-a470-4e50-b7aa-bd055d6e9555 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1318 microversion: 2.1 time: 0.149122 Aug 27 03:31:31.529496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 228/421] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:31.533936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.534413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.540083 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.540527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.541508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.542228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.566538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ae581cb3-ed98-439c-b244-8123cb2ec51f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/ips" status: 200 len: 145 microversion: 2.1 time: 0.035922 Aug 27 03:31:31.567078 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 229/422] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:31.627283 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-54fa274d-7471-4850-ae8b-0695cf5ec188 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 200 len: 38264 microversion: 2.20 time: 0.126199 Aug 27 03:31:31.628076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 194/423] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:31 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 38264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:31.638594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.639074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:31.645914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.646549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.647748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:31.648370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:31.674278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-525790e1-81a0-48f8-8692-6f9df069e34f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/ips" status: 200 len: 151 microversion: 2.20 time: 0.039915 Aug 27 03:31:31.674863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 230/424] 10.222.0.58 () {60 vars in 1289 bytes} [Fri Aug 27 03:31:31 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:32.102146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.102689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:32.112498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.113541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.115022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.115811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.244779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.252314 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6081e213-bfe8-4c74-afc9-a155ded694cd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.154285 Aug 27 03:31:32.252892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 195/425] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:32 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:32.389917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.390787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:32.400644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.401952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.402758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.403186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.438376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-398cfdb8-f22f-4187-b154-297ceaf84516 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052315 Aug 27 03:31:32.438936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 231/426] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:32 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:32.546974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.547697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:32.556813 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.557569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.558437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:32.558867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:32.697185 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.704871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f8cf6530-e87f-44c5-8046-3dc44b214404 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1508 microversion: 2.1 time: 0.162308 Aug 27 03:31:32.705412 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 196/427] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:32 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:32.916652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1693230935", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-831302725", "security_groups": [{"name": "tempest-secgroup-smoke-592614223"}], "networks": [{"uuid": "86a24c14-9a31-45eb-af67-a58be595d161"}], "block_device_mapping_v2": [{"uuid": "c39528a5-d37a-4e3b-a2f4-57b969817a03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:33.038032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] validate_networks() for [('86a24c14-9a31-45eb-af67-a58be595d161', None, None, None, None, None)] {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:33.272778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.273927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:33.283398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.283840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.286807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.287227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.469001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:33.469492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:33.469864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:33.470286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:33.470764 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:33.479895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.480353 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.481129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.481554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.481660 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:33.489027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-193e04db-2a09-46f3-af64-dda2777afdc0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.220119 Aug 27 03:31:33.489586 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 197/428] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:33 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:33.494295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.495308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:33.501319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.501454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for project 90c43de7a6384b82b35f14a762da5d37. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:33.501758 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.502511 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:33.503129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:33.506617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Getting quotas for user e7811e8849c74b2b9aa9182bec90fc7d and project 90c43de7a6384b82b35f14a762da5d37. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:33.533212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fdb26877-799f-4b71-aea0-bc7080cc23c3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042317 Aug 27 03:31:33.533656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 198/429] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:31:33 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:31:33.576083 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:33.578531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c39528a5-d37a-4e3b-a2f4-57b969817a03',volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:33.702222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-438048827", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:33.728836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cfb1fac2-b5cc-491e-b46f-6827d61106a3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815032 Aug 27 03:31:33.729664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 232/430] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:32 2021] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:31:33.740348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-631889a6-1761-4f1c-9109-7ef788b9a80f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.740957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-631889a6-1761-4f1c-9109-7ef788b9a80f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:33.775834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] validate_networks() for [('a9d0e3dc-f6eb-451d-9080-c35ce2cc6db3', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:31:33.824322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-631889a6-1761-4f1c-9109-7ef788b9a80f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:33.844652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-631889a6-1761-4f1c-9109-7ef788b9a80f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1088 microversion: 2.1 time: 0.108035 Aug 27 03:31:33.845639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 233/431] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:33 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1088 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.002337 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:34.003182 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.012886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.013318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.014086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.014505 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.039579 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lazy-loading 'flavor' on Instance uuid 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:31:34.235320 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:34.235760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:34.236222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:34.236610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:34.237179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:34.247042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.247841 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.248852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.249510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.270057 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:34.274952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Getting quotas for user b0959c5e5b1c49a9b5395f90360ce934 and project 01d740e2fdbb43f696818d258b9b3f4d. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:34.287896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:31:34.290252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:31:34.339143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6b32d800-127f-41a4-9791-b14fdf30e9b6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641698 Aug 27 03:31:34.340404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 199/432] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:31:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:34.350180 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-98f1a784-7c77-4dce-b1a5-3b5546736970 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.350782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-98f1a784-7c77-4dce-b1a5-3b5546736970 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.403305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-019cb0c8-5f9e-48eb-a626-66be6b973339 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 202 len: 0 microversion: 2.20 time: 0.404646 Aug 27 03:31:34.404417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 234/433] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:31:33 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:34.413705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.414823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.422033 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.422797 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.423770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.424335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.424487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-98f1a784-7c77-4dce-b1a5-3b5546736970 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.434029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-98f1a784-7c77-4dce-b1a5-3b5546736970 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1217 microversion: 2.1 time: 0.087424 Aug 27 03:31:34.434608 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 200/434] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:34 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:34.505903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.506614 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.514535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.514980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.515821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.516548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.609648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.618938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.621136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.622495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e1854ae9-2a3d-4c00-ab01-1a73ebaaaa4f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.213605 Aug 27 03:31:34.623051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 235/435] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:34 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:34.676530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.684982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a0527726-0eb0-4e8e-8896-1a70d08c00cb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.182814 Aug 27 03:31:34.685558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 201/436] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:34 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.862857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.863623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:34.871897 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.872337 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.873138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:34.873574 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:34.937081 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.947727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9a0c957f-871f-498f-a6a9-c6e3ee04d95d tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1186 microversion: 2.1 time: 0.089044 Aug 27 03:31:34.948292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 236/437] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:34 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.050319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43f7de90-aefd-4f63-a595-a44d6e364af1"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:35.055255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.063753 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.064581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.065725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.066187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.375311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-79526f99-58b0-4cc3-b9b2-0adb3d3fc0c2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332174 Aug 27 03:31:35.376032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 202/438] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:35 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:35.450829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.451493 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.457942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.458379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.459144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.459769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.540302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.549539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-81c29835-1566-44b7-bceb-769dbfca7b64 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1269 microversion: 2.1 time: 0.102089 Aug 27 03:31:35.550206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 237/439] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.641489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.646213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.652354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.652792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.653559 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.653979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.701814 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.703507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:35.709755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.710247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.711072 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:35.711590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:35.996427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.004940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.006587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.008120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-62e63b31-aeaf-458b-9445-38891c53c3ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.370900 Aug 27 03:31:36.022892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 203/440] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:36.028911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.029797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.035792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.036220 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.037041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.037471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.056862 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.066611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8c529611-384f-49b6-b1b3-a6b4cd952a6c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.368534 Aug 27 03:31:36.067260 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 238/441] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:35 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.381326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.399111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ecb044d2-7b68-473e-a192-4ce873f7f875 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1271 microversion: 2.1 time: 0.374742 Aug 27 03:31:36.399907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 204/442] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:36 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.569888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.570910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:36.577573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.578083 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.578911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:36.579463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:36.695583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.707288 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ff3bfd2f-89c7-481e-a6fe-b034e940fce8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1275 microversion: 2.1 time: 0.138641 Aug 27 03:31:36.707983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 239/443] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:36 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.030806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.031628 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.058266 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.058572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.059530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.060138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.086528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.087704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.095170 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.098697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.099770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.100422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.707980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.715523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.716499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.718272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.722530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0067ddd2-72a5-4a71-84fe-428dcb3907fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.695959 Aug 27 03:31:37.722530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 205/444] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:37.726096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.726690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.733218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.733532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.734681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.734681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.735784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-04bf02c1-4d62-4748-b978-b91d29cfe19c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.653708 Aug 27 03:31:37.736450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 240/445] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.743670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.744778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:37.751261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.751778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:37.752628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:37.753161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.210850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.218539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.223285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d81f191d-cdbb-4b82-b6b8-f11b4e35429c tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.500431 Aug 27 03:31:38.228742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3c6bc216-6378-422f-bb56-00d56606ad79 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.490863 Aug 27 03:31:38.231428 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 241/446] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.233270 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 206/447] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:37 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.237801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-d68a1e62-b1fd-4919-bf09-278d2703d42a req-e524498e-46d2-4604-a58c-3c02fa5ae3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:38.239373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:38.239373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:38.248063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-d68a1e62-b1fd-4919-bf09-278d2703d42a req-e524498e-46d2-4604-a58c-3c02fa5ae3ee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.248492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-d68a1e62-b1fd-4919-bf09-278d2703d42a req-e524498e-46d2-4604-a58c-3c02fa5ae3ee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.259675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-d68a1e62-b1fd-4919-bf09-278d2703d42a req-e524498e-46d2-4604-a58c-3c02fa5ae3ee service nova] Creating event network-changed:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:31:38.265315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-d68a1e62-b1fd-4919-bf09-278d2703d42a req-e524498e-46d2-4604-a58c-3c02fa5ae3ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Aug 27 03:31:38.265905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 242/448] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:38.740519 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.741238 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:38.749249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.750191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.751417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.751891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.758674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.758674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:38.765297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.765743 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:38.766510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:38.766931 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.110345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.121990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-efa5a6df-4dd5-4b71-9aed-9a03d379a9de tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.371899 Aug 27 03:31:39.122298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.122654 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 243/449] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:38 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:39.135000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.137062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.138269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4770c75e-8a65-49df-8e8b-90fb74810bae tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.401918 Aug 27 03:31:39.138834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 207/450] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:38 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:39.240459 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.241307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:39.247912 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.248436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.249181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.249475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.249871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:39.249997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.268939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.269354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.270172 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:39.270598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:39.689253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.696914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-422e56ea-b5dc-402f-a59d-7caf3a66b43e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.452039 Aug 27 03:31:39.697477 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 208/451] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:39 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:39.698285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.707141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-12b5b447-a383-4b87-9097-3191775c84fa tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.470499 Aug 27 03:31:39.707706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 244/452] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:39 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.142691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.143258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.152053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.152504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.153302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.153726 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.156913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.157477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.163340 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.163848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.164615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.165073 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.343213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.346726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.354377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7835ba76-ca5d-47a9-936a-f5ca1034493e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.217355 Aug 27 03:31:40.355150 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 209/453] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.357672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.359445 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.360795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-73f63799-c7a1-45ed-b3a0-8ce80b636568 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.207648 Aug 27 03:31:40.361798 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 245/454] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:40.362134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-48a9c0ba-3df5-4e63-a2e3-eb8d67666c0f req-a2f270ef-c820-4c2a-a1ff-f94748b30fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6175dc67-2b16-477f-b0fa-db605b5b41f9", "tag": "6b05bda1-93a4-41e5-bdff-1409450b75ca"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:40.363943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:40.363943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:31:40.371743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-48a9c0ba-3df5-4e63-a2e3-eb8d67666c0f req-a2f270ef-c820-4c2a-a1ff-f94748b30fa3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.372332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-48a9c0ba-3df5-4e63-a2e3-eb8d67666c0f req-a2f270ef-c820-4c2a-a1ff-f94748b30fa3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.383365 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-48a9c0ba-3df5-4e63-a2e3-eb8d67666c0f req-a2f270ef-c820-4c2a-a1ff-f94748b30fa3 service nova] Creating event network-changed:6b05bda1-93a4-41e5-bdff-1409450b75ca for instance 6175dc67-2b16-477f-b0fa-db605b5b41f9 on hv-cinder-80473 Aug 27 03:31:40.388481 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-48a9c0ba-3df5-4e63-a2e3-eb8d67666c0f req-a2f270ef-c820-4c2a-a1ff-f94748b30fa3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031988 Aug 27 03:31:40.389088 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 210/455] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:40.714541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.715226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.721724 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.722352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.723308 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.723906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.725155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.726138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:40.738010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.739051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:40.740062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:40.740981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.217205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.225113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e38d7bb7-0721-48fb-9184-bcf80e79026f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.514774 Aug 27 03:31:41.225697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 246/456] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.248934 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.257084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7a36948b-df65-44af-a0aa-4d8f326384da tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.536072 Aug 27 03:31:41.257621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 211/457] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:40 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.372707 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.374706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.379582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.380184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:41.381289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.381747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.382494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.382923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.386368 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.386816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.387612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:41.388037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:41.560586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.568642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-edd7308e-9a74-4a07-873a-c092d106f7ba tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.199839 Aug 27 03:31:41.569192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 247/458] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.572405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.580611 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.582122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.583259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-26b4b3fb-1d7f-4054-a3cb-5d5694df8b28 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.207567 Aug 27 03:31:41.583867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 212/459] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:41 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:42.246071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.246726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.253644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.254136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.254972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.255477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.278039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.278654 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.285164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.285608 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.286384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.286810 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.451906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.459690 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bcdaa936-5895-4afa-9210-58071f408ddf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.219640 Aug 27 03:31:42.460281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 248/460] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:42.470183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.478012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-98b7a479-a5d7-46b1-aa23-3c6a3fc1e3af tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.206069 Aug 27 03:31:42.478798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 213/461] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:42.589981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.590567 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.598629 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.599075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.599891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.600316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.602988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.603651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:42.610345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.610794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.611596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:42.612026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:42.787217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.793964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.795665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f82df966-74f7-4a41-9775-21bf42aefe46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.212112 Aug 27 03:31:42.796786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 249/462] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:42.802056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.803573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.805191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-61ab9e03-2bca-44b3-88bf-115263ff12dc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.205949 Aug 27 03:31:42.805755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 214/463] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:42 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:43.479729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.480335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.487511 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.487958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.488722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.489142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.496347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.497102 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.503543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.503996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.504839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.505299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.665007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.672953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-21231d53-1850-4947-b81e-0c03b13e0987 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.199253 Aug 27 03:31:43.673574 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 250/464] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.685749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.692928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-82f476d6-65d6-4269-aa35-713dd6ab6a43 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.200601 Aug 27 03:31:43.693494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 215/465] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.814922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.815749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.824902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.825404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.826198 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.826620 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.829259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.830312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:43.836510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.836954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:43.837716 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:43.838141 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.023034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.027579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.030786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3d7f30ae-faa9-4569-bc79-49572ac1a2b9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.219905 Aug 27 03:31:44.031430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 251/466] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:44.035950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-00052889-7bfa-4143-9190-0fe9d7ef4b03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:44.036101 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.037548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.038795 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3a0d805e-c52d-4cbb-99ce-bcbed7c674b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.214746 Aug 27 03:31:44.039535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 216/467] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:43 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:44.042140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00052889-7bfa-4143-9190-0fe9d7ef4b03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.042641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00052889-7bfa-4143-9190-0fe9d7ef4b03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.104578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-00052889-7bfa-4143-9190-0fe9d7ef4b03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Going to try to stop instance {{(pid=108336) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 03:31:44.150382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-00052889-7bfa-4143-9190-0fe9d7ef4b03 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 202 len: 0 microversion: 2.1 time: 0.117657 Aug 27 03:31:44.150990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 252/468] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:31:44 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:44.160360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.161356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.167884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.168255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.169603 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.170044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.298857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.307233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-68b0ffa5-1bea-4c6b-bc41-e1600b5512da tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.151202 Aug 27 03:31:44.307837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 217/469] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.690519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.691189 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.698212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.698646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.699384 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.699837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.709980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.710568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:44.716726 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.717169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.717921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:44.718347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:44.902625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.905986 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.907074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c8ae3b1a-24ec-4aac-aea9-1836d6a142bf tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.220592 Aug 27 03:31:44.907683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 253/470] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.913421 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dd366c73-0898-4bbb-9688-af9f1169ec79 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.207191 Aug 27 03:31:44.913976 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 218/471] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:44 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.047884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.048390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.055269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.055739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.056510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.057039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.057721 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.058469 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.065728 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.066176 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.066954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.067413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.244202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.249883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.252104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b15fb74d-f453-4671-9ce3-8302d391185e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.207989 Aug 27 03:31:45.252663 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 254/472] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.257898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.259507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.260663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7acd8b2e-81ff-4c80-a0ae-33c5733d068a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.207334 Aug 27 03:31:45.261241 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 219/473] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:45.324258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.324767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.331682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.332128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.332892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.333316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.471595 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.480397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-953a7567-b16b-41e5-aff0-3b223d163136 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.159932 Aug 27 03:31:45.480972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 255/474] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.931430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.932277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.938631 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.939694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.940144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.940643 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:45.940917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.941348 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.948736 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.949182 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:45.950039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:45.951158 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.127878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.132767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.135666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-282aff32-c47b-4e53-a4f0-5da46cb54073 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.212503 Aug 27 03:31:46.136408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 220/475] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.140682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5540fb4d-8384-40f7-99ab-cea298cbd7a7 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.213273 Aug 27 03:31:46.141407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 256/476] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:45 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.269794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.270389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.277173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.277632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.278781 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.279210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.279464 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.280009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.286331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.286768 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.287577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.288004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.456263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.463006 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.463794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-01fe2de9-2f7e-44b5-8b19-fe21d11a3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.197709 Aug 27 03:31:46.464342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 221/477] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.471491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.472964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.474197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3af2725e-e1ab-4a75-b57c-1bad770ceb77 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.198648 Aug 27 03:31:46.474902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 257/478] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:46.498053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.498661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:46.505323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.505890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.506759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:46.507206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:46.653115 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.662632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f426e616-d0b9-4daf-9de5-5d6758647bff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.168538 Aug 27 03:31:46.663200 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 222/479] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:46 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.157228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.159216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.161902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.162776 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.170478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.171130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.172183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.172315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.172644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.172775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.173416 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.173844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.361227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.365858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.368665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7a5c6328-4443-403f-8465-7b555f007354 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.218330 Aug 27 03:31:47.374134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7b0119cf-de70-4d16-89d9-ff9826919d36 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.218559 Aug 27 03:31:47.374497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 258/480] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.375196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 223/481] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.484851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.485437 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.492233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.492735 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.492907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.493169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.494449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.494874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.499076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.499468 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.500228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.500645 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.682024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.687116 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.689795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9ae45374-f264-4ae6-9781-48a38dfdba8c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.211106 Aug 27 03:31:47.690637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 259/482] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.695061 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.696079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.696667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:47.697233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.699531 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b580627b-4187-47fa-a0e8-e5d47eec731a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.210618 Aug 27 03:31:47.700811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 224/483] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:47.704725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.705161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.706617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:47.707475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:47.836307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.844646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-15111a59-a8c4-446d-bb34-3eb4b3a4675d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.153005 Aug 27 03:31:47.845617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 260/484] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:47 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.023763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-a170c7dc-69fc-4509-a4f3-f93ef39b8d51 req-4eccb6f7-bb6e-4264-9bb6-57fffdc80bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6175dc67-2b16-477f-b0fa-db605b5b41f9", "name": "network-vif-plugged", "status": "completed", "tag": "6b05bda1-93a4-41e5-bdff-1409450b75ca"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:48.025511 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:48.025511 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:31:48.035392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a170c7dc-69fc-4509-a4f3-f93ef39b8d51 req-4eccb6f7-bb6e-4264-9bb6-57fffdc80bf4 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.035899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a170c7dc-69fc-4509-a4f3-f93ef39b8d51 req-4eccb6f7-bb6e-4264-9bb6-57fffdc80bf4 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.049492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-a170c7dc-69fc-4509-a4f3-f93ef39b8d51 req-4eccb6f7-bb6e-4264-9bb6-57fffdc80bf4 service nova] Creating event network-vif-plugged:6b05bda1-93a4-41e5-bdff-1409450b75ca for instance 6175dc67-2b16-477f-b0fa-db605b5b41f9 on hv-cinder-80473 Aug 27 03:31:48.056588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-a170c7dc-69fc-4509-a4f3-f93ef39b8d51 req-4eccb6f7-bb6e-4264-9bb6-57fffdc80bf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036642 Aug 27 03:31:48.057665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 225/485] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:48.390358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.390953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.392393 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.393075 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.397903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.398370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.399106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.399552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.399662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.399990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.400746 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.401165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.582279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.587387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.589820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d5784fda-c678-45b7-8775-3f329f15f4f1 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.201631 Aug 27 03:31:48.590588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 226/486] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.597543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-37b1daed-9ea8-45ed-91a1-84e44c7490c4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.211096 Aug 27 03:31:48.608124 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 261/487] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.707201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.707827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.713975 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.714391 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.715143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.717264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.721961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.722756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.729426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.729857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.730599 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.731206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.905826 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.913666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.913850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-85457ff5-7fbf-48f3-bd09-0c58eac82110 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.210263 Aug 27 03:31:48.914378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 227/488] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.918838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.920255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:48.923680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.925168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.926381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.926698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a615a1e5-444f-439d-b754-bbc027312df4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.208579 Aug 27 03:31:48.926849 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:48.927296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 262/489] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:48.927673 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:48.928198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.071017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.079018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7c7d62aa-92fb-416f-ad15-60a23216bf2e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.163723 Aug 27 03:31:49.079601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 228/490] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:48 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.606763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.607449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.614113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.614560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.615276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.615739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.615835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.616077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.622235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.622658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.623473 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.623896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.797821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.804653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.809073 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7ef6f134-6ad0-41bc-a678-b8d3c28c4042 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.205816 Aug 27 03:31:49.810103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 263/491] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.814254 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1fdb031e-905a-4e7d-94d1-d43015e5ebc0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1317 microversion: 2.1 time: 0.202770 Aug 27 03:31:49.814818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 229/492] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.934450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.935546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.944690 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.945237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.946273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.946828 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.947916 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.948706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:49.955295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.955756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:49.956512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:49.956932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.123495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.131567 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-40e725fe-5841-4ca2-bb1e-7a1233cad979 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.203274 Aug 27 03:31:50.132131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 264/493] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.136386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.136647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.136965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:50.143696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.144209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.144995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.145423 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.146050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.147987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.149307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2a24662e-95d7-4d1a-9fa5-91b788f171e0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.206454 Aug 27 03:31:50.149951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 230/494] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:49 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:50.271527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.280131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-16a5e55c-b1af-4259-bd91-610affc0f959 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.146935 Aug 27 03:31:50.280709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 265/495] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:50 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.828727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.829363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:50.831767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.832384 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:50.836276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.836877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.837760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.838188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.839297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.839992 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:50.841669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:50.842168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.015727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.020421 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.023657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-58605ad9-c1f1-4222-b101-3fc9be4fc2ed tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.199861 Aug 27 03:31:51.024242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 231/496] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:50 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.028377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0e3943fb-059d-4092-9765-24627f16897a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1506 microversion: 2.1 time: 0.200426 Aug 27 03:31:51.029249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 266/497] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:50 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.150051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.150784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.157686 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.158120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.158888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.159309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.167669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.168260 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.174488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.174911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.175784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.176208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.359356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.363711 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.367114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-42ce3e63-af80-40c5-bcdb-4ac1933b3e57 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.222025 Aug 27 03:31:51.367724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 232/498] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:51 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.373761 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.374576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:51.380573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.380811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.381017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.381785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.382208 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.382368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.383579 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c71bfb62-3936-47da-9670-9c15535b782b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.219956 Aug 27 03:31:51.384128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 267/499] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:51 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:51.519905 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.533460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d6f2698c-d264-4928-8a5c-0e4a2694eb8c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.164326 Aug 27 03:31:51.534120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 233/500] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:51 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:51.914325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-74f48fc7-9414-49bd-8f0e-1b8447d4afcf req-30f373a4-ac5b-41e3-8db3-5eae50b7e93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "name": "network-vif-plugged", "status": "completed", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:51.915917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:51.915917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:51.923290 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-74f48fc7-9414-49bd-8f0e-1b8447d4afcf req-30f373a4-ac5b-41e3-8db3-5eae50b7e93e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:51.923997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-74f48fc7-9414-49bd-8f0e-1b8447d4afcf req-30f373a4-ac5b-41e3-8db3-5eae50b7e93e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:51.936401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-74f48fc7-9414-49bd-8f0e-1b8447d4afcf req-30f373a4-ac5b-41e3-8db3-5eae50b7e93e service nova] Creating event network-vif-plugged:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:31:51.942143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-74f48fc7-9414-49bd-8f0e-1b8447d4afcf req-30f373a4-ac5b-41e3-8db3-5eae50b7e93e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Aug 27 03:31:51.942783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 268/501] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:52.040967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.041815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.049122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.049566 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.051392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.051866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.191467 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.199681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b24a76f2-72ec-4074-a43f-002cbd6abba5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.162028 Aug 27 03:31:52.200370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 234/502] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:52.384540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.385261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.389846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e57c1cf-256f-428b-947b-64282c92baac"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:52.390979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.391888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.392333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.393108 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.393533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.398580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.399025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.399831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.400260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.518725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.533267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cda72e6d-4895-42e2-8195-ae80c7ac8cdc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.152422 Aug 27 03:31:52.534116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 269/503] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:52.541234 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.542064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.548824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.550924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.551609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.552024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.692614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.701849 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.703336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.704587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3c46238f-7aff-4bd0-a9b2-0d68ca95300e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.169233 Aug 27 03:31:52.705416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 270/504] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:52.709370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.710070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:52.716519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.717046 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.717943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:52.718376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:52.841803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d7b3c599-a71c-4ade-a3d7-65321d36a95d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "POST /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455187 Aug 27 03:31:52.842883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 235/505] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:52 2021] POST /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:52.849474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.857932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-da1cf729-c0fa-40c3-bd12-1d25c5112f27 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.151804 Aug 27 03:31:52.858747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 271/506] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:52 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.218681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.219243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.229093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.229534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.230292 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.230718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.373784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.379387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f70c9f6e-ed92-42d8-9e34-3309b55ca9b0 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1259 microversion: 2.1 time: 0.164929 Aug 27 03:31:53.380196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 236/507] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.554448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.555128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.561287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.561784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.562634 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.563065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.690800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.698868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8ff84554-4f95-489a-a7a2-d288160779e8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.148554 Aug 27 03:31:53.699482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 272/508] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.723124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.723737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.730357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.730798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.731662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.732074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.875721 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.876316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.876920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:53.883237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.883756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.884530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.884680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:53.884941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:53.886297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.888264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b430bec3-af63-4b03-bfe5-b0020fb7b82b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.168626 Aug 27 03:31:53.888906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 237/509] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:54.027934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.036331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44c03e7b-16a4-4be0-9cec-8e0f73eb57f2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.164253 Aug 27 03:31:54.036902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 273/510] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:53 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:54.397043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.397468 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.404011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.404462 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.405218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.405640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.540956 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.549616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-36e720fb-9532-4802-a745-c901641effbb tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1443 microversion: 2.1 time: 0.157167 Aug 27 03:31:54.550174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 238/511] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:54.566457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.567019 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.573355 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.573792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.574540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.575164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.716834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.717781 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.719525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.724381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.724914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.725778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.726268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.727237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6f16dc1c-ef7b-450b-804f-0f6340373def tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1443 microversion: 2.1 time: 0.164467 Aug 27 03:31:54.727833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 274/512] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:54.849808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.857559 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cfc7d33d-9138-48d9-bf9c-9db26861c3d6 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.144905 Aug 27 03:31:54.858091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 239/513] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:54.906296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.906886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:54.913326 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.913729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:54.914489 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:54.914911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.046099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.054345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.055848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.056985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ecda1628-46ce-4b7c-a3fa-5eb94c4d0ab4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.154542 Aug 27 03:31:55.057589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 275/514] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:54 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:55.088297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.088980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:55.094619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.095052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.095843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.096262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.224789 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.233209 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-44af1df7-86fa-40d4-bb25-6e86f59b2fa1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.148597 Aug 27 03:31:55.233748 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 240/515] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:55 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:55.875255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.875867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:55.882484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.882928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:55.883748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:55.884177 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.010732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.019702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6c50fd67-5798-4a08-88d6-40dad238dbb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.148733 Aug 27 03:31:56.020445 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 276/516] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:55 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:56.075397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.076207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:56.082360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.083319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.084143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.084747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.219263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.227091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.228596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.229735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-48e8662f-d649-4464-9a6d-53d966f71e45 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1742 microversion: 2.20 time: 0.158129 Aug 27 03:31:56.230267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 241/517] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:56 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:56.251221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.251841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:56.257892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.258336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.259090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.259541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.388224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.396454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bacb0376-a10f-4ce5-ab81-b26e6253006c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.148894 Aug 27 03:31:56.397006 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 277/518] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:56 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:56.772251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-e4903108-d328-4264-8f1a-951344649298 req-660b0ca5-bb55-4b3b-a66c-524f3149b7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:56.773835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:56.773835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:31:56.781110 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-e4903108-d328-4264-8f1a-951344649298 req-660b0ca5-bb55-4b3b-a66c-524f3149b7d6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:56.781541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-e4903108-d328-4264-8f1a-951344649298 req-660b0ca5-bb55-4b3b-a66c-524f3149b7d6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:56.792320 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-e4903108-d328-4264-8f1a-951344649298 req-660b0ca5-bb55-4b3b-a66c-524f3149b7d6 service nova] Creating event network-changed:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:31:56.797583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-e4903108-d328-4264-8f1a-951344649298 req-660b0ca5-bb55-4b3b-a66c-524f3149b7d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028893 Aug 27 03:31:56.798108 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 242/519] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:57.037972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.038568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.044754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.045192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.045928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.046608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.250193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.250839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.260289 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.260733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.261508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.261930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.522927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.532217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f7f53b80-65e9-4396-b55f-f20997c26ad4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.497850 Aug 27 03:31:57.532833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 278/520] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.537441 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.538027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:57.545315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.546135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.547457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:57.547794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.548647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:57.557103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.558734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.560170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3a8e4f2e-925c-4c87-9b24-565f301a25b4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1742 microversion: 2.20 time: 0.315518 Aug 27 03:31:57.560940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 243/521] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1742 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:31:57.790347 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.799909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0c9a9070-eefc-4355-bd60-ce14a9854682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.265670 Aug 27 03:31:57.800730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 279/522] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:57 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:58.553546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.554750 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.562934 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.563370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.564169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.564574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.617961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.618585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.624954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.625393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.626149 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.626578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.729327 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.738470 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a962b8f2-94f3-4a1a-8c87-342f557184c3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.191166 Aug 27 03:31:58.739018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 244/523] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:58 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:58.744798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbeaa545-1d3d-4161-9c1f-ca18ae0bceb9", "device": "/dev/sdb"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:58.747070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.753780 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.754341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.755476 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.756138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.776920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.785227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.786811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.787964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4b6b29c3-8f50-4ebf-9214-c08384ae8a40 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1742 microversion: 2.20 time: 0.173758 Aug 27 03:31:58.788506 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 280/524] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:58 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:31:58.817990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.818577 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:58.824758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.825198 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.826001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:58.826424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:58.948597 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.957447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9c839744-e41e-4073-bea7-febe43c61c0c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.143024 Aug 27 03:31:58.958013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 281/525] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:58 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:59.122104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b073d65a-4a06-4c4d-8389-0bcf40dc1104 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "POST /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381740 Aug 27 03:31:59.122747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 245/526] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:31:58 2021] POST /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:59.760554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.761509 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:59.769685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.770174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.770946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.771376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.807167 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.808777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:31:59.815801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.816333 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.817172 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.817846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.957191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.965501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aff7d52d-49ff-4cfa-b23c-b49cee3190ed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.211330 Aug 27 03:31:59.966401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 282/527] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:59 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.972250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-3cd1e9c6-3b60-44df-a8f1-3b6523e53a22 req-3db3919b-55ee-4670-b201-fbad6f8b1e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "name": "network-vif-plugged", "status": "completed", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:59.974651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:31:59.974651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:31:59.983153 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-3cd1e9c6-3b60-44df-a8f1-3b6523e53a22 req-3db3919b-55ee-4670-b201-fbad6f8b1e9f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:59.983603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-3cd1e9c6-3b60-44df-a8f1-3b6523e53a22 req-3db3919b-55ee-4670-b201-fbad6f8b1e9f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:59.984520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.993426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.994915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.995612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-3cd1e9c6-3b60-44df-a8f1-3b6523e53a22 req-3db3919b-55ee-4670-b201-fbad6f8b1e9f service nova] Creating event network-vif-plugged:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:31:59.996101 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8c43f3a7-4e75-4ac9-a7b8-cbe3f5cfc3b5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1742 microversion: 2.20 time: 0.193699 Aug 27 03:31:59.996722 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 246/528] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:31:59 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:00.001207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.001800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:00.007618 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.008059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.008819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.009160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-3cd1e9c6-3b60-44df-a8f1-3b6523e53a22 req-3db3919b-55ee-4670-b201-fbad6f8b1e9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040684 Aug 27 03:32:00.009260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.009926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 283/529] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:31:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:00.135033 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.143205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b80568ac-e623-4c0c-ab2f-4851600a8c1d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.145254 Aug 27 03:32:00.143857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 247/530] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:31:59 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:00.982762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.983548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:00.990652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.991085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:00.991889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:00.992306 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.015442 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.016164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.022221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.022823 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.023990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.024547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.182146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.191467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-15829a24-9df9-4685-8481-f36c2d897e0b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.212762 Aug 27 03:32:01.192350 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 284/531] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:00 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:01.197716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.198813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.205091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.207258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.207986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.208867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.209309 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.213765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.215416 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.216756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-869fdbee-5a9e-48c8-bef7-03271e4e1a67 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.206569 Aug 27 03:32:01.217821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 248/532] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:01 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:01.350917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.359986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-789c5b69-8756-4f16-9d20-204fb4a160e3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.166406 Aug 27 03:32:01.360485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 285/533] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:01 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:01.583139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.583676 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.590284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.591153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.591612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.595971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.721077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'services' on Instance uuid 6175dc67-2b16-477f-b0fa-db605b5b41f9 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:01.822248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1dc9a234-7657-4099-8742-733e17d2c1b3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments/1e57c1cf-256f-428b-947b-64282c92baac" status: 202 len: 0 microversion: 2.1 time: 0.249970 Aug 27 03:32:01.823333 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 249/534] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:32:01 2021] DELETE /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments/1e57c1cf-256f-428b-947b-64282c92baac => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:01.839052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.842987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:01.855165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.857962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.858955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:01.859460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:01.912195 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-57e4bc6c-818d-4edd-b132-c10d917b7945 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083940 Aug 27 03:32:01.916960 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 286/535] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:01 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:02.209335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.210620 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.218093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.219714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.223491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.224984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.235769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.236950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.249371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.254148 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.255180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.255786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.484065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.485958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.492882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.493492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e8cb59d9-d46a-412c-96fa-ef52ec85b064 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.288855 Aug 27 03:32:02.503383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 250/536] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.503383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.503383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.505819 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.507151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.507588 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8586361e-a9e7-4072-8b48-e87f790042e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.275108 Aug 27 03:32:02.508005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.508836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 287/537] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:02.509070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.509673 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.650576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.659757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-928461fe-affe-4f70-9587-189854386910 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.164265 Aug 27 03:32:02.661015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 251/538] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.924453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.926063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:02.936762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.937386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:02.938394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:02.938933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.045075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c1521072-0a52-42e7-b9c5-53e236d7ca96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124272 Aug 27 03:32:03.050477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 288/539] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:02 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:03.513457 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.514258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:03.520703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.521150 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.521925 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.527086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.528780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:03.533744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.538738 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.539215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.540677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.541125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.737558 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.739131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.745432 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.747095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.747306 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0c5b64ce-2916-4b7d-95ea-a52819b12643 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1521 microversion: 2.1 time: 0.237071 Aug 27 03:32:03.748134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 252/540] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:03 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:03.748258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cbe402ef-18cf-41ea-a80c-211281c95cfc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.224888 Aug 27 03:32:03.759393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 289/541] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:03 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:03.763268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.764164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:03.770488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.770933 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.771753 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:03.772367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:03.921299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.933414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ee908413-a8f0-403a-a3c6-94f67752a195 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.183942 Aug 27 03:32:03.934117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 253/542] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:03 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:04.068551 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.069507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.081123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.082002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.083940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.085916 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.128133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1bc6afb6-d15a-4e14-ab96-488a307dae0d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074042 Aug 27 03:32:04.128816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 290/543] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:04.768945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.769684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.769987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.770679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:04.775608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.776236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.776729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.777260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.777518 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.778125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.778337 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:04.778853 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:04.974401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.977007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.986989 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.988541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.989048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c2c65ae7-e34c-4e16-a864-00ddf1c261b7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1501 microversion: 2.1 time: 0.223710 Aug 27 03:32:04.989685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5e880a94-bc30-44fe-a3d3-1d589729574c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.224715 Aug 27 03:32:04.990546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 291/544] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:04.994820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.995439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:05.000304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 254/545] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.001681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.002130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.002903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.003327 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.048715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.051570 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:05.066747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.067188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.067995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.068418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.180892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:05.191717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a1132c80-668d-453e-9852-5345fe6c2ea1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.199971 Aug 27 03:32:05.192661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 292/546] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:04 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.197709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.198607 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:05.206271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.206713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.207723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:05.208207 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:05.240862 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cfbd4405-71f3-4354-957d-5f6ba9f6a8f8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Aug 27 03:32:05.244495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 293/547] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:05 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:05.261471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:05.269872 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bdb20d3a-7d11-4d0f-b99a-d8cad0e1d716 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1515 microversion: 2.1 time: 0.248976 Aug 27 03:32:05.270533 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 255/548] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:05 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:06.018249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:06.018835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.026351 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.027096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.027886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.028452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.162194 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.174385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.176008 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.177268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ec854a2a-7275-48aa-8979-45d4068dd4cb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.163052 Aug 27 03:32:06.177842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 294/549] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:06 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:06.209037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:06.210302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.217548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.217990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.218819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.219242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.255434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:06.256264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.269019 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.269546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.270928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.271572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.313003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fae1b683-978d-41db-8cff-7eb54ffd25fa tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061301 Aug 27 03:32:06.313841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 295/550] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:06 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:06.364653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.373855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-39d92688-0e9b-4efd-81be-fd2cdb49bdb7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.168803 Aug 27 03:32:06.374861 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 256/551] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:06 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:06.747832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:06.749120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.756182 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.756815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.757778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.758360 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.784541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lazy-loading 'flavor' on Instance uuid f95f90b2-f020-440a-81cf-5e339f032c8b {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:06.911915 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-526ce04f-60fd-4c02-b18a-be29db6351bc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action" status: 200 len: 32 microversion: 2.1 time: 0.167728 Aug 27 03:32:06.912820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 296/552] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:06 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:06.923283 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:06.923960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:06.931313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.931898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:06.932691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:06.933118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.178165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.194456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-373136cd-ebb1-40fb-bdc2-b675415fb8cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.274487 Aug 27 03:32:07.206930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 257/553] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:06 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:07.212394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.213185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:07.220975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.221812 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.222703 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.223167 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.326709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.328671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:07.342739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.343454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.345604 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.346386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.390567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c6ae3f43-1512-49fb-af4d-5518cebf8f7a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069770 Aug 27 03:32:07.391146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 258/554] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:07 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:07.397502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.398415 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:07.406090 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.406524 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.407724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:07.411781 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:07.439109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.462973 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.466277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.469980 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-23dc20aa-4423-4d63-be27-09e6c7560dea tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.260749 Aug 27 03:32:07.471558 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 297/555] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:07 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:07.642495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.650325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-77b2be4d-6be6-4566-8fea-e127b4cab202 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.258146 Aug 27 03:32:07.650884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 259/556] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:07 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:08.214159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.214748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:08.221939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.222733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.223952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.224536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.401147 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.402182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.403872 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:08.411995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.412681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.413451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.413871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.427627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bcc006e7-fbd3-4758-af1f-328e4792c1e3 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.217452 Aug 27 03:32:08.440872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 298/557] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:08 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:08.447994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6c55dce1-f7ea-4d60-b583-69acdc330320 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049696 Aug 27 03:32:08.448822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 260/558] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:08 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:08.489456 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.490379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:08.497193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.497641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.498392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.498810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.643482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.652393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.654746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.655925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4715d65f-94d2-4d8d-b0bc-9303d125e64e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.170575 Aug 27 03:32:08.656782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 299/559] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:08 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:08.673850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.674448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:08.681405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.682048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.682989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:08.683589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:08.813402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.821464 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-60b555b4-2bf8-4dd1-9fc9-5cbbb08c2fb9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.151885 Aug 27 03:32:08.831422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 261/560] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:08 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.449053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.450880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:09.458416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.458847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.459906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.460444 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.461128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.461495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:09.467879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.469792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.470617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.471265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.503159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6a4769a7-9d51-40ae-a6b2-0b6bc39d156d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Aug 27 03:32:09.507731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 262/561] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:09 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:09.597888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.606842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d604b047-6a12-44d7-8026-7c74b06aaaee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.161680 Aug 27 03:32:09.607492 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 300/562] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:09 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.675657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.676453 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:09.687745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.688272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.689150 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.689642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.833068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.837830 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.838429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:09.840859 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.842388 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.843767 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-00eda08f-8da8-4d02-8c36-f9dd01ac8aaf tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.171993 Aug 27 03:32:09.854424 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 263/563] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:09 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:09.854750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.855374 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:09.856554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:09.856824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.004639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:10.013864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5995646c-f57b-4eda-8a76-4879ef405234 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.179675 Aug 27 03:32:10.023904 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 301/564] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:09 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:10.515006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.515964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.522572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.523012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.523827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.524261 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.557396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8444e2dd-02aa-4eda-96e4-26afa96ad244 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 27 03:32:10.558066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 264/565] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:10 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:10.632316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.633153 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.639381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.639904 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.640765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.641204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.769136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:10.776397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f54d1a55-12e4-4dbb-9d3f-bae872b8933a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.150258 Aug 27 03:32:10.776953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 302/566] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:10 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:10.866174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.867159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:10.875735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.876173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:10.876930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:10.877348 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.003065 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.013917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.015401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.016567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5d13dd24-b1f8-41f7-a582-f2642107fbbc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.156878 Aug 27 03:32:11.017129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 265/567] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:10 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:11.031619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.032230 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.038058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.038507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.039269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.039782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.180615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.189138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7d71ea02-0dde-4714-8477-6e53e42bc1cf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.161467 Aug 27 03:32:11.189716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 303/568] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:11 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:11.573216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.574732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.584771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.585501 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.586768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.587518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.619914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a38b95fa-b555-48bb-988a-cb068c8e53d2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053026 Aug 27 03:32:11.620463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 266/569] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:11 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:11.796411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.797126 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:11.805152 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.805694 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.806625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:11.807146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:11.939322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.946902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6f6792c1-7fb8-4956-a45a-683e4d710d2f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.155759 Aug 27 03:32:11.947495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 304/570] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:11 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.038171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.039156 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:12.049176 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.049871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.051117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.051899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.204195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.206075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.206683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:12.212249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.212907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.213356 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.213662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.214184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.214613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.214927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e608f4cd-f483-4561-a517-6529bbcb4c25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.182828 Aug 27 03:32:12.215762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 267/571] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:12 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:12.335755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.343635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ed05b86c-f723-4d1b-a70b-a705f514e88d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.141401 Aug 27 03:32:12.344165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 305/572] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:12 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.635629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.637194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:12.644431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.644838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.645584 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.646002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.674902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-40f81ca2-2b4b-4e5a-aa54-6cd45318f2af tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Aug 27 03:32:12.675474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 268/573] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:12 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:12.968052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.968649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:12.974942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.975382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:12.976191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:12.976613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.110490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.122228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-04a94600-3302-461a-a372-9b4cd4aeca22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.160007 Aug 27 03:32:13.123063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 306/574] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:12 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:13.232747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.233267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.239463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.239915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.240717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.241140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.360313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.360912 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.367331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.367821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.368780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.369081 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.390656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.399374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.400969 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.402042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2e80e5be-2424-4315-8bb5-8a7ee7228df0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1737 microversion: 2.20 time: 0.173304 Aug 27 03:32:13.402857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 269/575] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:13 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:13.506243 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.514071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f7ed6378-ed11-4814-8f03-d948f470cd9d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.157506 Aug 27 03:32:13.514613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 307/576] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:13 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:13.686520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.687899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:13.694960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.695426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.696166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:13.696803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:13.731793 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ffbeaf94-a998-49d4-b628-639788bd69f2 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047866 Aug 27 03:32:13.732567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 270/577] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:32:13 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:14.140303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.141050 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.146973 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.147448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.148264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.148692 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.301022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.309112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d801f4e7-3e93-4367-86dd-11bfdb1a4aca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.172776 Aug 27 03:32:14.309758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 308/578] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:14 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.420518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.421116 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.427800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.428242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.429347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.429774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.531369 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.531976 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.538078 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.538516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.539275 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.539731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.565346 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.573390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.574902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.576121 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bc6b815d-4b14-466c-93cf-b6a86ea2b3a0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.159356 Aug 27 03:32:14.576692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 271/579] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:14 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:14.659918 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.668136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2417d15f-838e-4b43-9cd8-a34b2bdc7f8a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.140614 Aug 27 03:32:14.668696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 309/580] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:14 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.932132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.932696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:14.939526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.939976 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.940743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:14.941173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:14.965849 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:15.055963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4b761036-ecfd-4690-a608-3d6a9e33ce3b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 204 len: 0 microversion: 2.1 time: 0.127871 Aug 27 03:32:15.056979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 272/581] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:14 2021] DELETE /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:15.069585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.070184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.076207 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.076651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.077620 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.078480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.215964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.224327 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c2da9c5b-94aa-435a-941e-e7e220c1d57b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.160411 Aug 27 03:32:15.224894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 310/582] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.330074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.330805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.337374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.337819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.338590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.339014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.477221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.487683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dc9159c2-5051-4903-badd-2396b8e3f1e9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.163051 Aug 27 03:32:15.488254 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 273/583] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.598983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.600059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.609842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.610285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.611069 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.611535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.685986 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.686506 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:15.692486 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.692898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.693690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:15.694114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:15.748348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.756303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.757778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.758911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a404c120-5571-438a-b1fd-171740c351ef tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.166415 Aug 27 03:32:15.759460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 311/584] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:15.831840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.844844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a761148c-4e4e-4994-bce7-e42c45a9954a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.162364 Aug 27 03:32:15.845557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 274/585] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:15 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.245639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.246648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.257171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.257922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.259173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.259970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.399686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.407168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d9855327-ef8f-45c9-b227-c3db9189fd67 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.167803 Aug 27 03:32:16.407746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 312/586] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.509299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.510190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.521244 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.521962 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.523205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.524049 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.649650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.657971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-144eaf4a-9559-4f65-8271-85aaddf26dc2 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.155068 Aug 27 03:32:16.658540 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 275/587] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.776989 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.777495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.784822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.785259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.786043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.786476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.865122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.865814 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:16.872703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.873340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.874199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.874627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.951562 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.960378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.961977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.963249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cb0bc4d6-2688-4b77-9874-5be3589ae5e3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.190197 Aug 27 03:32:16.963902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 313/588] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:16.977731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-76e6b53f-2905-4603-bcb5-f86750d404d2 req-f4ab22a7-2464-4825-9fad-5e2f75788ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "name": "network-vif-unplugged", "status": "completed", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:16.979458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:16.979458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:32:16.987336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-76e6b53f-2905-4603-bcb5-f86750d404d2 req-f4ab22a7-2464-4825-9fad-5e2f75788ff5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:16.987941 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-76e6b53f-2905-4603-bcb5-f86750d404d2 req-f4ab22a7-2464-4825-9fad-5e2f75788ff5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:16.999734 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-76e6b53f-2905-4603-bcb5-f86750d404d2 req-f4ab22a7-2464-4825-9fad-5e2f75788ff5 service nova] Creating event network-vif-unplugged:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:32:17.004878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-76e6b53f-2905-4603-bcb5-f86750d404d2 req-f4ab22a7-2464-4825-9fad-5e2f75788ff5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035989 Aug 27 03:32:17.005637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 314/589] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:17.025002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.033201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d2a47beb-d29a-4116-8205-0e063afe2187 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1724 microversion: 2.1 time: 0.172543 Aug 27 03:32:17.033703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 276/590] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:16 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.425541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.426215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.433060 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.433495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.434250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.434667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.560593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.568884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a8dafc1d-283d-42b3-8ba6-38a014d3a642 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.147457 Aug 27 03:32:17.569448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 315/591] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:17 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.679214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.679980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.687305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.687846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.688760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.689291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.829870 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.837646 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-19ff073b-e8bc-4f12-98d0-fd663b27cb14 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.163337 Aug 27 03:32:17.838190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 277/592] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:17 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.981899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.982414 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:17.988429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.988875 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:17.989637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:17.990065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.050794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.051441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.057981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.058440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.059211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.059670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.147584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.156514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.158407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.159774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-41b2a29f-0f23-432c-9cd3-bd330314c314 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.181649 Aug 27 03:32:18.170460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 316/593] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:17 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:18.207290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.215763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fffadbeb-47d7-4f5f-834d-5b48bca3a79f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1701 microversion: 2.1 time: 0.169002 Aug 27 03:32:18.216364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 278/594] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:18 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:18.235749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-56a2727b-51f8-40a9-adc4-5e0a36c5f49f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:18.245608 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56a2727b-51f8-40a9-adc4-5e0a36c5f49f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.246222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56a2727b-51f8-40a9-adc4-5e0a36c5f49f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.271164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-56a2727b-51f8-40a9-adc4-5e0a36c5f49f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Going to try to start instance {{(pid=108336) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 03:32:18.324380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-56a2727b-51f8-40a9-adc4-5e0a36c5f49f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 202 len: 0 microversion: 2.1 time: 0.094766 Aug 27 03:32:18.325135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 317/595] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:18 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:18.333768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.334460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.341100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.341673 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.342478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.343100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.481826 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.489944 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-755306cf-ecdc-45fa-92ea-ed2173195ebf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1710 microversion: 2.1 time: 0.160220 Aug 27 03:32:18.490624 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 279/596] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:18 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.591548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.592811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.601848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.602666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.604434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.605037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.854664 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.855297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:18.862208 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.862653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:18.863564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:18.863992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.052760 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.060899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f52c303c-0b33-4367-8e79-99f0bb035145 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.476784 Aug 27 03:32:19.061471 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 318/597] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:18 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:19.065710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.074464 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a4507891-7f26-428b-96ac-bede27c59575 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.223516 Aug 27 03:32:19.075264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 280/598] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:18 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:19.182564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.183612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:19.193921 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.194666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.196012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.196717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.350595 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.362548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.364064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.365210 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-03a4a22d-2e6a-4172-9be6-75c3243b6464 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.189203 Aug 27 03:32:19.365747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 319/599] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:19 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:19.508531 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.509096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:19.516195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.516765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.517643 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:19.518389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:19.646913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.654705 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c7e35785-4da8-4d33-be85-ce4ed29202b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1710 microversion: 2.1 time: 0.150084 Aug 27 03:32:19.655262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 281/600] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:19 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:20.079792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.080394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.087036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.087600 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.088375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.089196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.093845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.094446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.100797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.101237 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.102018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.102448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.270677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.275530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.278523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-041d4218-f4d3-463c-b758-789034d7e4a8 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.202452 Aug 27 03:32:20.279125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 320/601] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:20 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:20.283637 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2f00058d-db2d-4847-bf17-c45775ad0bed tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.193523 Aug 27 03:32:20.284494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 282/602] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:20 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:20.386339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.386995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.394945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.395459 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.396265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.396712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.528728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.541075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.543401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.545171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-142a170f-635b-4b6f-bcd6-81d97433b43c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.164934 Aug 27 03:32:20.546016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 321/603] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:20 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:20.676102 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.676725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:20.683299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.683775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.684539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:20.684968 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:20.813249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.822081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-69c914fa-4416-46d4-a76b-8bb4fdca7f09 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1710 microversion: 2.1 time: 0.150977 Aug 27 03:32:20.822658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 283/604] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:20 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.300661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.301277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.302647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.303215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.307866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.308311 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.309084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.309507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.309659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.310102 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.310861 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.311278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.493635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.498081 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.501578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-37aae0cc-bd16-4126-8eb1-b3329b934fa0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.207498 Aug 27 03:32:21.502160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 322/605] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.506838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-af5abfa9-4fe3-4390-9942-d346eb555b24 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.209030 Aug 27 03:32:21.507446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 284/606] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.570062 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.570880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.580832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.581529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.582255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.582676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.718621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.727092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.728604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.729720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-22e1e2dd-e492-4898-8ab6-914a15616a87 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.166215 Aug 27 03:32:21.730272 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 323/607] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:21.843451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.844341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:21.852367 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.852800 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.853547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:21.853952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:21.990502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.003609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-91bbc18c-69d0-4d8b-8c94-5408a34e7367 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1710 microversion: 2.1 time: 0.166159 Aug 27 03:32:22.004650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 285/608] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:21 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:22.518165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.519250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.523622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.524226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.526647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.527189 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.528259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.528948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.530554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.530989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.532096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.532544 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.799755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.808702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a731c6ba-890c-441c-8ad7-8c584ce94f0b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.294228 Aug 27 03:32:22.809499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 324/609] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:22.809620 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.816646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.817743 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:22.826944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.827157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2b1ff8bc-226a-48cc-9a83-940d661d7908 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.307188 Aug 27 03:32:22.827779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:22.828124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 286/610] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:22.828995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:22.829424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.021729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.022358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.040438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.040879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.041692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.042051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.046127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.056734 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.058661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.060051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-46817ced-a684-470e-8e30-8990ba491318 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1719 microversion: 2.20 time: 0.248789 Aug 27 03:32:23.060842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 325/611] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:22 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:23.237745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.246251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c109851e-7ae1-4389-9b43-ff86b062ec8f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1710 microversion: 2.1 time: 0.228550 Aug 27 03:32:23.246856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 287/612] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1710 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.826217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.826906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.833262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.833708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.834701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.835163 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.845248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.845822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:23.854571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.855002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:23.855874 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:23.856309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.064935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.072975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4ebf682a-09d3-4029-9099-bc5e10615f83 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1512 microversion: 2.1 time: 0.250527 Aug 27 03:32:24.075824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 326/613] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.080886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.081773 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.083543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.088558 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.089333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.090327 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.090926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.092322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-83ff548a-a0c3-4369-bb1f-0e08541ef89b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.250659 Aug 27 03:32:24.092934 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 288/614] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:23 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.264636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.265377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.272581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.273025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.273803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.274233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.329667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.338099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.339597 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.340716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b4de6188-283b-49a6-887a-886ee2ab4ee5 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1662 microversion: 2.20 time: 0.263833 Aug 27 03:32:24.341284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 327/615] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:24 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1662 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:24.357601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "330cdf7c-f0f3-4edf-9fa2-c5cc274ce2e8"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:24.358627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.364648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.365216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.365970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.366398 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.508330 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.524026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bff805b1-fe10-422b-9754-f8241fa7b088 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1714 microversion: 2.1 time: 0.263946 Aug 27 03:32:24.524765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 289/616] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:24 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1714 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.658208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2c2ad57e-a0d6-449d-a46e-ff7c43120648 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304198 Aug 27 03:32:24.658880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 328/617] 10.222.0.58 () {62 vars in 1364 bytes} [Fri Aug 27 03:32:24 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:24.790147 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:24.790715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.796568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.797018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.803838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-39856342-0de9-4f35-9724-bbf71170228f req-ad900d75-b39a-4343-86ae-262108ea03d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6175dc67-2b16-477f-b0fa-db605b5b41f9", "name": "network-vif-deleted", "tag": "6b05bda1-93a4-41e5-bdff-1409450b75ca"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:24.804345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.804963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.805440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:24.805440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:32:24.813884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-39856342-0de9-4f35-9724-bbf71170228f req-ad900d75-b39a-4343-86ae-262108ea03d2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.814104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-39856342-0de9-4f35-9724-bbf71170228f req-ad900d75-b39a-4343-86ae-262108ea03d2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.825732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-39856342-0de9-4f35-9724-bbf71170228f req-ad900d75-b39a-4343-86ae-262108ea03d2 service nova] Creating event network-vif-deleted:6b05bda1-93a4-41e5-bdff-1409450b75ca for instance 6175dc67-2b16-477f-b0fa-db605b5b41f9 on hv-cinder-80473 Aug 27 03:32:24.830983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-39856342-0de9-4f35-9724-bbf71170228f req-ad900d75-b39a-4343-86ae-262108ea03d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 Aug 27 03:32:24.832478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 329/618] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:24.903093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9dac6d6b-0924-497f-8de8-fa3b13a2b734 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action" status: 202 len: 0 microversion: 2.20 time: 0.117579 Aug 27 03:32:24.904111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 290/619] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:32:24 2021] POST /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:24.912424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.913482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:24.920365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.921147 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:24.922728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:24.923320 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.074810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.083288 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.084861 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.086007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fe51ad90-6205-4ca9-9ceb-fab52e760e84 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1748 microversion: 2.20 time: 0.177904 Aug 27 03:32:25.086554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 330/620] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:24 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:25.090126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.090931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:25.097334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.097790 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.098552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.099184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.109128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.109752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:25.117758 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.118196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.119154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.119807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.134092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:25.134884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:25.135513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 6175dc67-2b16-477f-b0fa-db605b5b41f9 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:25.186873 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.194801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-221141b7-7d66-47f9-ab37-e32ee3b92635 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 200 len: 1307 microversion: 2.1 time: 0.108581 Aug 27 03:32:25.195408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 291/621] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:25 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:25.268713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.279797 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d3c1975a-81ed-4035-ba59-39329c48599f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.172225 Aug 27 03:32:25.280950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 331/622] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:25 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:26.053888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.054384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.060479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.060917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.061673 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.062127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.104124 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.104671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.112943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.113593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.114782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.116335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.155166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lazy-loading 'services' on Instance uuid 266886ac-4054-4dc4-afe2-5737087f1b90 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:26.238161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e2caded0-3439-465e-84b3-6e1abc96026f tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90/os-volume_attachments/cbeaa545-1d3d-4161-9c1f-ca18ae0bceb9" status: 202 len: 0 microversion: 2.1 time: 0.188533 Aug 27 03:32:26.239291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 292/623] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:32:26 2021] DELETE /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90/os-volume_attachments/cbeaa545-1d3d-4161-9c1f-ca18ae0bceb9 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:26.244525 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.245357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 6175dc67-2b16-477f-b0fa-db605b5b41f9] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.252231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.252768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.253642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.254170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.269702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.280012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.280912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Instance 6175dc67-2b16-477f-b0fa-db605b5b41f9 could not be found. Aug 27 03:32:26.281652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 404 to user: Instance 6175dc67-2b16-477f-b0fa-db605b5b41f9 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:26.281791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.282687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d38d8efa-52c4-4f9c-9e42-344c88f5d1d9 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9" status: 404 len: 111 microversion: 2.1 time: 0.042194 Aug 27 03:32:26.282886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ed9f2ca6-1368-43b6-a415-67aba81a3600 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1750 microversion: 2.20 time: 0.182459 Aug 27 03:32:26.283502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 293/624] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/6175dc67-2b16-477f-b0fa-db605b5b41f9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:26.287872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 332/625] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:26.298902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.299755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:26.306531 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.306973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.307781 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:26.308208 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:26.441769 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.449983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bf116ac0-af8e-4990-97c0-8a743c64eef7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.155108 Aug 27 03:32:26.450599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 294/626] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:26 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.302653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.303679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.310241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.310716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.311515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.311937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.445595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.446815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.454882 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.455314 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.455786 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.456576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.457008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.465759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.467383 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.468554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-937e14a6-a383-4035-91da-0adb5924f088 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1750 microversion: 2.20 time: 0.169849 Aug 27 03:32:27.469130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 333/627] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:27.478926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.478926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.482232 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.482679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.483029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:27.483503 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.483930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.568248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e7ec5ad2-c943-4cca-9db1-0c9f2ea76368 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 204 len: 0 microversion: 2.1 time: 0.127460 Aug 27 03:32:27.569742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 295/628] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:27 2021] DELETE /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:27.578015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.579040 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:27.586037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.586485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.587322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:27.587929 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:27.622245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.630278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e83cb0ab-fcce-4a24-a50e-161236a7ecb7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.159999 Aug 27 03:32:27.630942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 334/629] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.715259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.723079 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d2bbe158-468c-4538-9306-6504fff10334 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.149635 Aug 27 03:32:27.723684 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 296/630] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:27 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:28.486667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.487195 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.493332 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.493785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.494508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.494960 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.649929 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.650697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.656894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.657417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.658275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.658765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.678765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.687859 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.689677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.690933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f63b3566-42dd-425e-92dd-383b6b8d16c3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.208052 Aug 27 03:32:28.691586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 335/631] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:28.742793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.743377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:28.749382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.749840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:28.750696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:28.751133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.111635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.119557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e64a4c29-1f3d-40ea-95d8-e24adca5b515 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1501 microversion: 2.1 time: 0.475305 Aug 27 03:32:29.120130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 297/632] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.136617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "632f6cd0-b13e-46ac-893e-9bfdcdbb8752"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:29.137765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.144058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.144504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.145279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.145734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.170665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] HTTP exception thrown: Cannot 'attach_volume' instance f95f90b2-f020-440a-81cf-5e339f032c8b while it is in vm_state rescued Aug 27 03:32:29.171249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Returning 409 to user: Cannot 'attach_volume' instance f95f90b2-f020-440a-81cf-5e339f032c8b while it is in vm_state rescued {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:29.172109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5c139fdb-e0a0-45bc-a211-177c8fe8c29c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040110 Aug 27 03:32:29.172665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 298/633] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:32:29 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:32:29.181183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:29.181700 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.187812 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.188068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.188774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.189169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.239801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.249169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-71620cb3-8762-4416-b9e2-e3fcafdd3c3e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.510972 Aug 27 03:32:29.250122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 336/634] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:28 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:29.264190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c71489f8-0e6b-4599-843c-be55d569c0c7 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.086813 Aug 27 03:32:29.265010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 299/635] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:29 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:29.273156 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.274000 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.279981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.280426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.281197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.281625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.451714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.459905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-12d31e8f-35ef-4e8f-bdc7-b67e05dcac6a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.190493 Aug 27 03:32:29.462015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 337/636] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.514475 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.515043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.521186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.521618 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.522364 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.522906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.550804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:29.635123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b1e2f1d4-5f3d-4707-896f-a058d72806b0 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 204 len: 0 microversion: 2.1 time: 0.124444 Aug 27 03:32:29.635775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 300/637] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:29 2021] DELETE /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:29.644415 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.645752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.653619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.654645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.655695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.656346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.710297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.711782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:29.717541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.718045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.718879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:29.719389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:29.946089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.953911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-207de298-d11f-4484-a45f-9c2e8e778437 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.314050 Aug 27 03:32:29.954507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 338/638] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.020297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.029532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.031058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.032263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4edb1da2-b479-43ca-a1d6-67152bb13150 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.326619 Aug 27 03:32:30.032846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 301/639] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:29 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:30.274604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.275213 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.281893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.282338 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.283116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.283566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.415037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.423241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-48195338-cca3-46f7-84c1-0e5ca9ef0860 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.157598 Aug 27 03:32:30.423965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 339/640] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.478729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.479332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.487122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.487881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.489210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.489967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.628998 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.636727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e90b5991-4c40-4456-b221-b9bfdccb3527 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.162096 Aug 27 03:32:30.637316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 302/641] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.971841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.972453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:30.979630 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.980084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:30.980864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:30.981281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.051619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.052274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:31.058924 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.059400 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.060365 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.060799 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.121257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.129110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f0f9594a-796d-4d92-a0c9-025fdf06b336 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.161180 Aug 27 03:32:31.129986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 340/642] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:30 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:31.207639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.216858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.218358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.219564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-14d8663f-7edc-4092-af2f-d64e9877df8e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.172605 Aug 27 03:32:31.220139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 303/643] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:31 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:31.445164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.446131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:31.452749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.453196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.453964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.454389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.583813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.592135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-080d693c-d1a6-4b49-85fa-a5101ccdb27d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.153625 Aug 27 03:32:31.592740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 341/644] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:31 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:31.655592 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.656103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:31.664084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.664527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.665292 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:31.665716 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:31.796343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.805080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dcc9c422-30d2-4535-99fc-c386e0f5bd4e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.152437 Aug 27 03:32:31.805779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 304/645] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:31 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.147139 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.147866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.154433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.155254 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.156058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.156517 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.238243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.238936 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.245632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.246142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.246986 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.247510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.300736 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.311038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b0c6fb57-e357-41e1-b940-d797a46d1d72 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.167522 Aug 27 03:32:32.312682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 342/646] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.381415 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.390225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.391940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.393159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-aaf76250-19f6-4259-82f7-fce855f75fc1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.158753 Aug 27 03:32:32.393724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 305/647] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:32.612059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.612888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.620240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.620676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.621451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.621874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.751760 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.759766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-03f24b96-ec3b-4ff4-afd0-f41eb18b26d6 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.153603 Aug 27 03:32:32.760335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 343/648] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.822251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.822870 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:32.829231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.829675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.830448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:32.830856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:32.967776 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.975825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-91d3a8e1-4640-44f7-908f-e741e6efba7c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.157303 Aug 27 03:32:32.976420 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 306/649] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:32 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.333666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.334358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.340522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.340967 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.341728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.342154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.413085 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.414586 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.421353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.421775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.422723 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.423158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.500767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.509205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9b8897ca-d6b2-42bf-864a-7f7075427598 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.179412 Aug 27 03:32:33.509988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 344/650] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.562787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.571932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.573474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.574623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-53537427-df2e-4dbb-812f-e3da1bbdd682 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.166193 Aug 27 03:32:33.575170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 307/651] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:33.776874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.777473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:33.784276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.784746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.785573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:33.785925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:33.918997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.926843 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b684d131-96df-4462-82b4-ef4b9a857091 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.153763 Aug 27 03:32:33.927410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 345/652] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.997038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.998016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.008532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.008957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.010114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.010740 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.153370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.161076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8cd1da27-60e7-4688-8986-6383a1e288a1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.170166 Aug 27 03:32:34.164249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 308/653] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:33 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:34.526249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.526873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.533329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.533767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.534534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.534926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.593446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.594225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.600043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.600476 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.601425 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.601996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.694485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.705040 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bc38f3cf-36f2-4ac1-836a-33f1a232f84a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.182399 Aug 27 03:32:34.705848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 346/654] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:34.755168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.764127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.765615 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.766771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-11663caa-9ba6-41f3-bdab-aad4b90cd098 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.177114 Aug 27 03:32:34.767331 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 309/655] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:34.944229 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.944733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:34.951061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.951612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:34.952386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:34.952811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.083696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.092122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0d114176-1a61-4c09-9a1b-3546d7f970a0 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.151657 Aug 27 03:32:35.092934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 347/656] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:34 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.179016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.180165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.186603 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.187122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.188232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.188741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.317576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.326254 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-383e6c1e-21fa-430d-b211-c37fbbba1e46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.151088 Aug 27 03:32:35.327115 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 310/657] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.724258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.725463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.733408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.734127 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.735098 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.735684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.785155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.785907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:35.792245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.792683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.793453 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:35.793904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:35.896058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.909851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-da8a33c4-d39b-423a-b572-d626d76fc32a tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.189573 Aug 27 03:32:35.910792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 348/658] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.953758 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.963177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.964717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.965895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c8c17b8b-2c9c-4d12-bba9-abeeca8f4238 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.184648 Aug 27 03:32:35.966459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 311/659] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:35 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:36.109889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.110480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.117789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.118239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.119032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.119488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.255694 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.264183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dffac76c-94c8-4368-829f-af1039cd2db5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.158052 Aug 27 03:32:36.264785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 349/660] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.344280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.345049 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.353491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.354048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.355138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.355763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.494432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.502621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ae04b295-9231-422e-ad82-dc6f565ff2d5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.162410 Aug 27 03:32:36.503286 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 312/661] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.927626 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.928656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.935099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.935572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.936360 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.936789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.984913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.986259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:36.993649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.994154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:36.995022 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:36.995563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.091554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.100414 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-56bd58bd-8d11-4a92-b283-79221c6fa3b4 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.176542 Aug 27 03:32:37.101253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 350/662] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.154651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.163536 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.165218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.166405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1355bfeb-8a02-43ac-86a9-2937f9335f25 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.185494 Aug 27 03:32:37.166960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 313/663] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:36 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:37.285310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.285845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:37.293101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.293536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.294306 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.294735 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.429878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.437241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f5bb8941-d1a1-40ab-8980-a58917f6a062 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.155859 Aug 27 03:32:37.437833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 351/664] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:37 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.520094 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.520694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:37.527121 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.527593 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.528397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:37.528823 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:37.659897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.669318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7dc29542-fa9e-4ee2-a4f4-adb3754a6b7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.152779 Aug 27 03:32:37.670421 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 314/665] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:37 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.118281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.118927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.125614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.125935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.126761 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.127180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.185358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.185993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.193535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.194234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.195091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.196520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.288475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.296217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e2f68171-6c84-4690-ab0d-e2e9cc4b4872 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.181581 Aug 27 03:32:38.298278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 352/666] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.373284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.384542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.386055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.387201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5220eca1-5572-4211-9955-10f52c82f4b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.205995 Aug 27 03:32:38.396880 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 315/667] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:38.456334 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.457059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.463899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.464343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.465116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.465542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.601897 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.612369 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-941dfbb1-cf2d-4081-a9be-8e09874fad2d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.159622 Aug 27 03:32:38.613163 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 353/668] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.686983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.687711 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:38.694105 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.694625 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.696213 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:38.696722 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:38.827146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.834811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9178d84e-9f7e-421a-b541-4be1215e23a8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.151654 Aug 27 03:32:38.835733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 316/669] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:38 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.314848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.315484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.321531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.321906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.322727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.323157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.406766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.407417 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.416566 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.417159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.417948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.418411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.452817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.460859 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f0ad3ea2-c4e9-4f6e-a0ae-8c6d938b346d tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.149869 Aug 27 03:32:39.461702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 354/670] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.545912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.555269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.557072 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.558403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-635a9fa0-422b-4177-a96d-db4bb475596b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.155397 Aug 27 03:32:39.558978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 317/671] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:39.631318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.632040 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.641224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.641868 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.642965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.643613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.793419 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.801154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f2391a5d-b06d-497f-8cf7-06a7117ae76d tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.173656 Aug 27 03:32:39.809085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 355/672] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.853190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.853794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:39.863165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.863991 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.865217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:39.865855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:39.997139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.005374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2271a929-9fc0-4532-9832-736918335ae9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.156407 Aug 27 03:32:40.005952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 318/673] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:39 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.482226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.482879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.489204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.489642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.490402 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.490831 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.577834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.578343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.588214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.588705 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.589459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.589883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.627239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.636536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b231f6d1-ae0c-4be7-9ced-a630cdada9ba tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.157063 Aug 27 03:32:40.639497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 356/674] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.725139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.734641 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.736234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.737387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-206f6a76-4a04-4c3e-a1dc-4ac505838252 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.163834 Aug 27 03:32:40.737982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 319/675] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:40.819776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.820444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:40.827172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.827705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.828420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:40.828846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:40.958550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.968081 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-753a58d2-c867-4af9-8427-8b61587e4d11 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.152073 Aug 27 03:32:40.968782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 357/676] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:40 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.023640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.024504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.031820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.032271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.033051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.033484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.163944 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.172264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9e72e3a5-30d1-4ffc-947f-25ae7d172d73 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.152316 Aug 27 03:32:41.173088 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 320/677] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.653516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.654151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.660080 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.660619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.661486 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.661969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.756521 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.757165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.764376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.764899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.765748 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.766272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.824560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.835956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a17835b6-5cce-4316-8481-d45e9887f82c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.186691 Aug 27 03:32:41.836775 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 358/678] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.909252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.917751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.919222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.920378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f9743a13-055f-4975-9515-67f392fcd63d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.167846 Aug 27 03:32:41.920928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 321/679] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:41.989086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.989978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:41.996732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.997216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:41.997977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:41.998527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.142285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.152236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b8786bf3-2c37-4bba-a183-4026b3ec0327 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.167789 Aug 27 03:32:42.153535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 359/680] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:41 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.189803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.190529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.198013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.198543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.199598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.200144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.337500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.345448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6f558acf-5dc0-4bd6-906d-de63d6b41a16 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.159906 Aug 27 03:32:42.346012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 322/681] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.855296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.856047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.863062 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.863538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.864335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.864970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.940005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.940719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:42.950655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.951084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:42.952024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:42.952411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.035677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.044496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-42b55f50-9156-48a3-afb7-225c1093cfe2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.193384 Aug 27 03:32:43.045247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 360/682] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.096826 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.101556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:32:43.101740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:32:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:32:43.105608 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.107009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.108154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4a939b22-5dbf-44cf-948a-68a30b0344b8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.171969 Aug 27 03:32:43.108894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 323/683] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:42 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:43.169571 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.170310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:43.179094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.179834 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.181174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.182018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.327908 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.336363 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9ab75c24-3f07-42d4-9d56-158292c91f13 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.170503 Aug 27 03:32:43.337216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 361/684] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:43 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.363576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.364155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:43.370789 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.371257 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.372106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:43.372563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:43.517283 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.526454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-de8a84ac-4dde-4b94-b719-45d706895263 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.166992 Aug 27 03:32:43.527004 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 324/685] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:43 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.062997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.063645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.069950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.070400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.071172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.071671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.128277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.128915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.135892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.136369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.137335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.137958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.243022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.251379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f73a9c71-785b-49f6-993d-1ba6622f49c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.192143 Aug 27 03:32:44.252304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 362/686] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.301815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.312725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.314638 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.315764 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7f56f7a0-683f-4e2b-82f0-01387e0d9ae3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.191257 Aug 27 03:32:44.316709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 325/687] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:44.354382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.354990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.361183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.361617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.362380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.362826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.510696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.518114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9e5fe819-f273-45c3-8024-3b4df927342a tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.167467 Aug 27 03:32:44.518664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 363/688] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.545305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.545904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:44.552071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.552508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.553623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:44.554000 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:44.698224 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.705860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-56983a6e-df9f-404b-bd75-04a956dfb69d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.164154 Aug 27 03:32:44.706418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 326/689] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:44 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.270268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.271693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.279055 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.279727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.280715 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.281288 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.334038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.334757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.340797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.341242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.342009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.342451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.444106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.453845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dfb66b44-de6d-4043-b941-c62bd66a3a34 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.188640 Aug 27 03:32:45.454568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 364/690] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.492575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.502431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.503951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.505105 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-321ce3f9-2297-4a0d-b25e-ee6ec6963adc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.174803 Aug 27 03:32:45.505658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 327/691] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:45.537047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.537826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.545665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.546165 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.546995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.547481 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.680454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.688788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b62bb585-75be-4392-b1d5-dc1b5859e8a1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.156818 Aug 27 03:32:45.689318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 365/692] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.723764 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.724412 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:45.730956 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.731430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.732195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:45.732649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:45.875785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.886293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-91f55e23-bf1f-4a79-a38f-79551047139c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.165434 Aug 27 03:32:45.887305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 328/693] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:45 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:46.471519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.472146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.478265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.479021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.479825 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.480247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.523916 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.524632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.534790 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.535231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.536007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.536425 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.748706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.756368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-afb72bca-d1e6-4372-aec6-c4937943c773 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.288468 Aug 27 03:32:46.757140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 366/694] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:46 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.761674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.762263 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.768169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.768602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.769359 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.769766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.781778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.792200 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.794371 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.795789 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-774ebfb5-6834-4c99-a9ea-16d4a800ed48 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.275549 Aug 27 03:32:46.807448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 329/695] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:46 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:32:46.909598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.910204 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:46.917214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.917739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:46.924991 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:46.925713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.042689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.051783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-613b9049-6a88-4904-8e53-3a6236c572e4 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 200 len: 1514 microversion: 2.1 time: 0.293613 Aug 27 03:32:47.052453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 367/696] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:46 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.058050 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-43f1f51f-5492-4b7c-888d-d17f423e3a86 req-0cfa5c45-d895-4e8c-95b0-0cc7c6dae34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bae22e-2148-4695-89b6-0ca9fe64214e", "name": "network-vif-deleted", "tag": "9f3da0a3-b185-45ff-b4d2-014e05b788f5"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:47.060020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:47.060020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:32:47.067794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-43f1f51f-5492-4b7c-888d-d17f423e3a86 req-0cfa5c45-d895-4e8c-95b0-0cc7c6dae34f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.068238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-43f1f51f-5492-4b7c-888d-d17f423e3a86 req-0cfa5c45-d895-4e8c-95b0-0cc7c6dae34f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.081472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-43f1f51f-5492-4b7c-888d-d17f423e3a86 req-0cfa5c45-d895-4e8c-95b0-0cc7c6dae34f service nova] Creating event network-vif-deleted:9f3da0a3-b185-45ff-b4d2-014e05b788f5 for instance 33bae22e-2148-4695-89b6-0ca9fe64214e on hv-cinder-80473 Aug 27 03:32:47.088000 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-43f1f51f-5492-4b7c-888d-d17f423e3a86 req-0cfa5c45-d895-4e8c-95b0-0cc7c6dae34f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033734 Aug 27 03:32:47.088900 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 368/697] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:47.123749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.132420 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-316f4f01-b108-41ca-8546-2263431e7ff1 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1509 microversion: 2.1 time: 0.226598 Aug 27 03:32:47.133248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 330/698] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:46 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.774458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.775154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.782617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.783063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.783945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.784372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.816040 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.816747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:47.823619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.824167 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:47.825027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:47.825529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.081812 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.089745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f7ae82e3-8eb8-475f-bf06-81b14e2c41df tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1514 microversion: 2.1 time: 0.319502 Aug 27 03:32:48.092434 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.100246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 369/699] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.105681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.106727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 33bae22e-2148-4695-89b6-0ca9fe64214e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.108322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.110984 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.112418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3f731a43-46a9-4c3b-aefc-cd5d56b4fe38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.299892 Aug 27 03:32:48.113240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 331/700] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:47 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:48.114011 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.114456 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.115243 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.115690 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.131869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Instance 33bae22e-2148-4695-89b6-0ca9fe64214e could not be found. Aug 27 03:32:48.132498 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 404 to user: Instance 33bae22e-2148-4695-89b6-0ca9fe64214e could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:48.133346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c6a638c1-24bc-4960-8d61-c4df9b092b1b tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e" status: 404 len: 111 microversion: 2.1 time: 0.031858 Aug 27 03:32:48.133894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 370/701] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:48 2021] GET /compute/v2.1/servers/33bae22e-2148-4695-89b6-0ca9fe64214e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:48.142934 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.143547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.150155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.151480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.151793 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.152393 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.154030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.154455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.159242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.159892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.160771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.161423 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.185356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:48.273077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-651ed59f-42ac-46c2-8d31-b4d16aec1fc5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 204 len: 0 microversion: 2.1 time: 0.134281 Aug 27 03:32:48.274024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 332/702] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:48 2021] DELETE /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:48.284445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.285122 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:48.290835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.291728 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.292898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:48.293370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:48.417323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.425081 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-805bb9c7-1c3f-4bf2-8d00-99c6e7b8fedf tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1515 microversion: 2.1 time: 0.278913 Aug 27 03:32:48.425650 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 371/703] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:48 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.532487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.542222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4fdc46b6-7807-4ea7-9d7b-9e09ba449e8e tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1513 microversion: 2.1 time: 0.262338 Aug 27 03:32:48.552893 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 333/704] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:48 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.106734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-c9c46b09-90a0-4fc3-a0ea-a937c293346c req-3eeb456f-8b81-4a37-ba94-bb056c125542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266886ac-4054-4dc4-afe2-5737087f1b90", "name": "network-vif-deleted", "tag": "1ef36c23-9824-4f9d-a2de-efeb158b70c0"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:49.108135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.108565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:49.108565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:32:49.109131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.115807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-c9c46b09-90a0-4fc3-a0ea-a937c293346c req-3eeb456f-8b81-4a37-ba94-bb056c125542 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.116326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-c9c46b09-90a0-4fc3-a0ea-a937c293346c req-3eeb456f-8b81-4a37-ba94-bb056c125542 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.117250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.117823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.118851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.119444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.129333 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-c9c46b09-90a0-4fc3-a0ea-a937c293346c req-3eeb456f-8b81-4a37-ba94-bb056c125542 service nova] Creating event network-vif-deleted:1ef36c23-9824-4f9d-a2de-efeb158b70c0 for instance 266886ac-4054-4dc4-afe2-5737087f1b90 on hv-cinder-80473 Aug 27 03:32:49.134398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-c9c46b09-90a0-4fc3-a0ea-a937c293346c req-3eeb456f-8b81-4a37-ba94-bb056c125542 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Aug 27 03:32:49.139079 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 334/705] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:49.144350 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.145046 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.152325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.152795 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.153545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.153965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.161156 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.161683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.162351 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lazy-loading 'fault' on Instance uuid 266886ac-4054-4dc4-afe2-5737087f1b90 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:49.456938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.467037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-449b22d6-bd52-4797-9dbb-e39a9dd7a938 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 200 len: 1308 microversion: 2.1 time: 0.363584 Aug 27 03:32:49.468019 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 372/706] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:49.523016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.531819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.533284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.534402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-989f7d81-b37a-46a2-af78-18d65dd3086a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.394125 Aug 27 03:32:49.534941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 335/707] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:49.561017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.561896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.568245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.568687 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.569447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.569942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.696098 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.703662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2760fcbb-8b72-40c3-ab5c-34b290049126 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1513 microversion: 2.1 time: 0.146918 Aug 27 03:32:49.704219 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 373/708] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.786102 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.786708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.792849 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.793244 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.794039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.794441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.926532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.935227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b2892376-967a-4211-b509-2f5ea978be09 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1515 microversion: 2.1 time: 0.152752 Aug 27 03:32:49.935821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 336/709] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:49 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.953134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeeb90e6-9ac6-4d5c-8c74-7656b0b1f92b"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:49.954236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:49.960699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.961132 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:49.961898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:49.962323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.240705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-57a4b03f-cddb-4559-8194-0bcebd1df831 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292292 Aug 27 03:32:50.241840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 374/710] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:32:49 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:50.484794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.485354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 266886ac-4054-4dc4-afe2-5737087f1b90] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:50.491083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.491543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.492298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.492719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.508124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] HTTP exception thrown: Instance 266886ac-4054-4dc4-afe2-5737087f1b90 could not be found. Aug 27 03:32:50.508730 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Returning 404 to user: Instance 266886ac-4054-4dc4-afe2-5737087f1b90 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:50.509557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ac3793c0-4ab2-4ce6-b5d2-c92f061f05a5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90" status: 404 len: 111 microversion: 2.1 time: 0.028601 Aug 27 03:32:50.510144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 337/711] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:50 2021] GET /compute/v2.1/servers/266886ac-4054-4dc4-afe2-5737087f1b90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:50.554041 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.555005 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:50.561324 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.562033 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.563013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.563669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.716794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.723591 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.724372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:50.727041 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.728770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.730279 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8162fcc5-96c3-4ec0-ab42-4d8bc6e24efc tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.180981 Aug 27 03:32:50.732108 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 375/712] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:50 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:50.739542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.739933 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.740898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.741326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.774924 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:50.775552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:50.776027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:50.816786 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.824451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a69e6b0a-d9d8-49a3-a864-a9de421962f5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1308 microversion: 2.1 time: 0.107311 Aug 27 03:32:50.825003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 338/713] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:50 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:51.155991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-2c398556-d349-4203-b07d-a111da2a584b req-a1d5b9fd-9f92-44cd-9db6-91f7eea1f6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90527ef8-4d61-4bc5-8ecc-ed05837e0dc5", "name": "network-vif-deleted", "tag": "81dbe444-5db9-4391-bed2-2330c577d434"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:51.158483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:32:51.158483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:32:51.169598 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-2c398556-d349-4203-b07d-a111da2a584b req-a1d5b9fd-9f92-44cd-9db6-91f7eea1f6fe service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.170028 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-2c398556-d349-4203-b07d-a111da2a584b req-a1d5b9fd-9f92-44cd-9db6-91f7eea1f6fe service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.182299 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-2c398556-d349-4203-b07d-a111da2a584b req-a1d5b9fd-9f92-44cd-9db6-91f7eea1f6fe service nova] Creating event network-vif-deleted:81dbe444-5db9-4391-bed2-2330c577d434 for instance 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 on hv-cinder-80473 Aug 27 03:32:51.188452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-2c398556-d349-4203-b07d-a111da2a584b req-a1d5b9fd-9f92-44cd-9db6-91f7eea1f6fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038647 Aug 27 03:32:51.189001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 376/714] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:32:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:51.750253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.750869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:51.757158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.757597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.758449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.758877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.843033 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.843769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:51.850726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.851178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.851994 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.852428 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.884838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.886253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:51.886700 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:51.887137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:51.893801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.895293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.896456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-16309895-4483-4d34-b218-e2bd5d2feeb7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.150054 Aug 27 03:32:51.897005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 339/715] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:51 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:51.934957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.942799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-df37548f-f726-49ad-bf83-1ff37b4daae5 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1308 microversion: 2.1 time: 0.104814 Aug 27 03:32:51.943304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 377/716] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:51 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.919599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.920356 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:52.929118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.929690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.930688 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.931253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.963212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.963808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:52.970103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.970544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:52.971306 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:52.971764 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:53.003103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:53.003656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:53.004203 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:53.048840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.056742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c9780546-bbd8-40e0-8e67-d97f29a5f2e3 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1308 microversion: 2.1 time: 0.097065 Aug 27 03:32:53.057412 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 378/717] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:52 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.074207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.082331 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.083829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.084980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4687ec43-abbf-49f3-b0dd-bb5cdccdde29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.170906 Aug 27 03:32:53.085511 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 340/718] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:52 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:54.074397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.075043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:54.082344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.082788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.083616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.084049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.108473 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.109066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:54.118188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.118798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.120240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.120806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.121500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:54.121945 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:54.122406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:32:54.178624 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.186957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f9015bf6-5024-4556-a59b-8457362e38c1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 200 len: 1308 microversion: 2.1 time: 0.116883 Aug 27 03:32:54.188035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 379/719] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:54 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.304684 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.309663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.311941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.313087 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-22f040f5-8be7-46aa-a46e-3d1db70550c0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.213232 Aug 27 03:32:54.313681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 341/720] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:54 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:55.205930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.206519 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:55.213170 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.213655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.214433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.214865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.229592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Instance 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 could not be found. Aug 27 03:32:55.230442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 404 to user: Instance 90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:32:55.231307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-286f64a5-c240-471d-9d42-b4ed4300a5da tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5" status: 404 len: 111 microversion: 2.1 time: 0.029451 Aug 27 03:32:55.231894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 380/721] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:55 2021] GET /compute/v2.1/servers/90527ef8-4d61-4bc5-8ecc-ed05837e0dc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:55.331655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.332266 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:55.339316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.339811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.340614 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:55.341039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:55.481301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.495030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.496579 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.497724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-69e43661-a754-48ee-8e42-ebe9a1250f5b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.169966 Aug 27 03:32:55.498275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 342/722] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:55 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:56.381507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.382129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.388452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.388937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.389759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.390240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.420995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:32:56.500841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-675e5222-e285-47a7-b1a4-efa1acb32b71 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 204 len: 0 microversion: 2.1 time: 0.122346 Aug 27 03:32:56.501704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 381/723] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:32:56 2021] DELETE /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:56.512747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.513369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.516759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.517379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:56.520138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.520783 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.521587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.522001 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.523145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.523642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.524389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:56.524808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:56.698691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.705461 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.705893 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6aaad882-75b6-4336-a9f3-ba64d691e7bc tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1513 microversion: 2.1 time: 0.197874 Aug 27 03:32:56.706452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 343/724] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:56 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.716776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.718384 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.719653 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9461d976-5bd5-48ef-b190-5fe33de673ba tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.206929 Aug 27 03:32:56.720210 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 382/725] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:56 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:57.721970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.722493 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:57.728694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.729127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.729879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.730296 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.738104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.738661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:57.745350 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.745876 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.746712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:57.747230 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:57.914552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.919404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.922832 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5fccd814-435e-4cc3-8c14-bad511447258 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1513 microversion: 2.1 time: 0.204466 Aug 27 03:32:57.923425 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 344/726] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:57 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.928382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.929888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.931024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a0e4bcfb-a924-4ce0-8ff6-e01690d3b083 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.196744 Aug 27 03:32:57.932208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 383/727] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:57 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:58.944245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.945423 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.952679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.953135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.953927 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.954343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.955043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.955671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:58.961956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.962386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:58.963137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:58.963585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.128097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.136191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e37f6364-f349-4f55-8d9c-845598434231 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1513 microversion: 2.1 time: 0.198138 Aug 27 03:32:59.136778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 345/728] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:32:58 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.140269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.150542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.152075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.153204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f2a04f77-53bc-4bf6-9b51-ce1d0b07cf82 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.201943 Aug 27 03:32:59.153792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 384/729] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:32:58 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:32:59.953526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:59.954422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:32:59.960904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.961343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.962091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:32:59.962816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:32:59.992269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lazy-loading 'flavor' on Instance uuid f95f90b2-f020-440a-81cf-5e339f032c8b {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:00.153648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.154323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:00.160969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.161420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.162220 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.162663 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.256340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cb3b08b5-4ce1-4200-8d1d-9b34c1491d06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action" status: 200 len: 32 microversion: 2.1 time: 0.306661 Aug 27 03:33:00.256951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 346/730] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:32:59 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:33:00.263316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.264033 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:00.271556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.272030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.272803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.273413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.300493 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.310231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6458f080-a506-4dbc-be47-f8ee6adcc21f tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1513 microversion: 2.1 time: 0.160647 Aug 27 03:33:00.310867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 385/731] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:00 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:00.315157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.315765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:00.322779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.322779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.324964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:00.324964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:00.531734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.540556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.542453 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.543666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4e9dc246-2c11-4ee7-8fce-05588c3231f1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.285430 Aug 27 03:33:00.544258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 347/732] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:00 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:00.548659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2038903488", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "4f81df06-e296-4035-a97c-b43d344f0b90"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:00.573901 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.582233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0589c057-f6ee-48c1-8351-f1e14e76fc35 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.270395 Aug 27 03:33:00.583148 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 386/733] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:00 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:00.606002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] validate_networks() for [('4f81df06-e296-4035-a97c-b43d344f0b90', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:33:01.184897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:01.185829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:01.186151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:01.186582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:01.187080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:01.197828 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.198736 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.199594 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.200019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.220082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Getting quotas for project 7dd6a8224c1149f6a978d9174fa5a7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:33:01.224660 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Getting quotas for user 6faa1a83294641068232fe1b173af45e and project 7dd6a8224c1149f6a978d9174fa5a7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:33:01.235816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:33:01.238188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:33:01.285261 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-73830ceb-12f5-46f4-a7a6-507a73339c99 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739947 Aug 27 03:33:01.286030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 348/734] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:33:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:33:01.296390 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-70d896e0-8f28-4538-8bb2-7145d0e2ae10 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.297036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-70d896e0-8f28-4538-8bb2-7145d0e2ae10 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.327713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.328434 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.337228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.337787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.338558 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.339026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.355887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-70d896e0-8f28-4538-8bb2-7145d0e2ae10 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.362629 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-70d896e0-8f28-4538-8bb2-7145d0e2ae10 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1219 microversion: 2.1 time: 0.069904 Aug 27 03:33:01.363547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 387/735] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.474106 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.482394 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a222fa59-2667-4ce0-b691-a451a5dbe994 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1513 microversion: 2.1 time: 0.158611 Aug 27 03:33:01.483392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 349/736] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:01.563126 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.563680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.569642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.570087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.570965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.571426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.600107 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.600981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:01.607926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.608411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.609284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:01.609711 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:01.818474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.827911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.829406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.830767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-52328f2a-17b6-4ff3-a931-39ca6b2a9983 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.271520 Aug 27 03:33:01.831697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 388/737] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:01.879162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.888481 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-023c831f-b50e-4357-aa1a-c60ee81c3150 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.291945 Aug 27 03:33:01.889066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 350/738] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:01 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.224655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-56942345-5544-4919-98c4-b16b1d5683af req-e16579d7-c09a-44ff-b29a-17c8e3980277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881", "name": "network-vif-deleted", "tag": "bad6539d-473a-4ae7-8574-1eba84cbf59d"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:02.234573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:02.234573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:33:02.242117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-56942345-5544-4919-98c4-b16b1d5683af req-e16579d7-c09a-44ff-b29a-17c8e3980277 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.242663 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-56942345-5544-4919-98c4-b16b1d5683af req-e16579d7-c09a-44ff-b29a-17c8e3980277 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.255006 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-56942345-5544-4919-98c4-b16b1d5683af req-e16579d7-c09a-44ff-b29a-17c8e3980277 service nova] Creating event network-vif-deleted:bad6539d-473a-4ae7-8574-1eba84cbf59d for instance 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 on hv-cinder-80473 Aug 27 03:33:02.260066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-56942345-5544-4919-98c4-b16b1d5683af req-e16579d7-c09a-44ff-b29a-17c8e3980277 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039769 Aug 27 03:33:02.260866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 389/739] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:02.343911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-2d1380be-aed2-4017-ba54-85d11cbdd1e6 req-8d69e213-3760-46f7-855a-dd32f38cd2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "name": "network-vif-plugged", "status": "completed", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:02.346251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:02.346251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:33:02.353719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2d1380be-aed2-4017-ba54-85d11cbdd1e6 req-8d69e213-3760-46f7-855a-dd32f38cd2f1 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.354318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2d1380be-aed2-4017-ba54-85d11cbdd1e6 req-8d69e213-3760-46f7-855a-dd32f38cd2f1 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.369378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-2d1380be-aed2-4017-ba54-85d11cbdd1e6 req-8d69e213-3760-46f7-855a-dd32f38cd2f1 service nova] Creating event network-vif-plugged:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:33:02.376895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-2d1380be-aed2-4017-ba54-85d11cbdd1e6 req-8d69e213-3760-46f7-855a-dd32f38cd2f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036465 Aug 27 03:33:02.378113 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 351/740] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:02.380784 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.382402 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.389897 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.395174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.397194 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.397730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.472018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.481460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1829ee36-c957-4334-8c84-dffc2f65d23c tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1279 microversion: 2.1 time: 0.104635 Aug 27 03:33:02.482315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 390/741] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.500718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.501498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.508578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.509005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.509956 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.510308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.541695 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.542444 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.542605 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lazy-loading 'fault' on Instance uuid 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:02.615174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0959c5e5b1c49a9b5395f90360ce934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d740e2fdbb43f696818d258b9b3f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.622737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bbe3599b-5f9c-46f4-9a8a-c769b65940b1 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 200 len: 1307 microversion: 2.1 time: 0.126053 Aug 27 03:33:02.623243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 352/742] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.852907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.853726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.861704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.862247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.863114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.863629 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.907074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.907979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:02.915015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.915712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:02.916878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:02.917561 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.161425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.170136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.171671 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.172804 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-242bd2a2-ea0c-4336-95fb-560153926563 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.326289 Aug 27 03:33:03.173440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 391/743] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:03.196845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.205443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9fc454f9-12ba-4bd6-b216-ff76a79c6268 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.301854 Aug 27 03:33:03.206110 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 353/744] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:02 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:03.497985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.498679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.504811 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.505525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.506451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.507021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.640087 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.640764 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] [instance: 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:03.647312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.647714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.648499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:03.648926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:03.664144 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] HTTP exception thrown: Instance 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 could not be found. Aug 27 03:33:03.664924 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] Returning 404 to user: Instance 3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:03.665774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ca0fb7f8-1f0b-4df7-9383-172801c3bf96 tempest-AttachVolumeNegativeTest-1196905115 tempest-AttachVolumeNegativeTest-1196905115-project] 10.222.0.58 "GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881" status: 404 len: 111 microversion: 2.1 time: 0.029454 Aug 27 03:33:03.666680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 354/745] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:03 2021] GET /compute/v2.1/servers/3d4b1b1c-f1f8-40a1-8ddf-4b4d6e836881 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:03.950030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.957799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-90905eff-750a-480d-97e5-7a37e9a04468 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.463483 Aug 27 03:33:03.958484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 392/746] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:03 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:04.192787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.193629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:04.205806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.206482 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.207489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.208147 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.221731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.222348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:04.228951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.229755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.230801 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.231479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.474947 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.483113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-273a820b-6c40-496c-89d7-88e2a3daba22 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.265007 Aug 27 03:33:04.483747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 393/747] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:04 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:04.500499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.509771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.511281 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.512442 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-74628835-a18b-4572-92e2-da253a19f708 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.324854 Aug 27 03:33:04.512970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 355/748] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:04 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:04.590956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-a3618abf-e183-4ebb-9eb3-451523da4d56 req-68bfd587-fe72-458e-bde4-15dd13c64c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffca0db-5614-4bf4-9dfd-82baf16ab054", "tag": "27f03c09-eef2-4905-81b1-c2bc4f2bc7fe"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:04.594273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:04.594273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:33:04.603304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-a3618abf-e183-4ebb-9eb3-451523da4d56 req-68bfd587-fe72-458e-bde4-15dd13c64c71 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.604391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-a3618abf-e183-4ebb-9eb3-451523da4d56 req-68bfd587-fe72-458e-bde4-15dd13c64c71 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.619069 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-a3618abf-e183-4ebb-9eb3-451523da4d56 req-68bfd587-fe72-458e-bde4-15dd13c64c71 service nova] Creating event network-changed:27f03c09-eef2-4905-81b1-c2bc4f2bc7fe for instance 2ffca0db-5614-4bf4-9dfd-82baf16ab054 on hv-cinder-80473 Aug 27 03:33:04.625071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-a3618abf-e183-4ebb-9eb3-451523da4d56 req-68bfd587-fe72-458e-bde4-15dd13c64c71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039127 Aug 27 03:33:04.625793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 394/749] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:04.974396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.975973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:04.994432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.995054 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:04.996041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:04.996541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.196888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.209794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8cb98339-450a-4be1-ba78-44c90f3f93d8 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.239333 Aug 27 03:33:05.211648 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 356/750] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:04 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.500381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.501210 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:05.507385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.507814 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.508559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.509200 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.531470 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.532325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:05.538919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.539887 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.541060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:05.541840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:05.781698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.791103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4efaa21a-b540-4b63-b187-b3fdf89df3ae tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.294648 Aug 27 03:33:05.792043 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 395/751] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:05 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.794474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.809121 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.810745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.811982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b3f858c6-2b41-4b8e-8aa3-d9a436c015d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1806 microversion: 2.20 time: 0.285676 Aug 27 03:33:05.812697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 357/752] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:05 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:06.225825 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.226527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.233125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.233572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.238482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.238482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.358676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.365942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aaa5ea30-ab40-4ce3-aeec-2658baaa0dd5 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.143796 Aug 27 03:33:06.366513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 396/753] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:06 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:06.809325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.809923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.815822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.816254 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.817034 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.817463 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.829787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.830486 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:06.836668 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.837174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:06.838034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:06.838446 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.009777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.018051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-409550be-337b-4630-9a22-e1edf155ef60 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.212620 Aug 27 03:33:07.028582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 358/754] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:06 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:07.031381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.039719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.041249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.042373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44a0244d-c5ad-4b83-8c10-81a823d235d6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1793 microversion: 2.20 time: 0.216283 Aug 27 03:33:07.042892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 397/755] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:33:06 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1793 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:07.386187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.386842 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:07.393044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.393503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.394289 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:07.394739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:07.522082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.530269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5b84e25e-c8c4-4a57-af1c-e101be518d68 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.148199 Aug 27 03:33:07.530839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 359/756] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:07 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.036089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.036719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:08.054318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.054810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.056199 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.056609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.190066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.198254 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a1f28501-ea7e-4ad3-9daa-13811855c5c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.165835 Aug 27 03:33:08.198955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 398/757] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:08 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.548133 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.549092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:08.555598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.556353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.557211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:08.557719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:08.686947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.694732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5f9a1e7e-15a3-45c8-ba19-697ce2afc459 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.151033 Aug 27 03:33:08.695430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 360/758] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:08 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:09.216522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.217222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:09.224535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.225245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.226097 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.226646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.361910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:09.376007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9615c560-9219-44cc-b0ab-7d90d8d091cc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.161545 Aug 27 03:33:09.376601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 399/759] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:09 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:09.713442 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.714064 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:09.720626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.721071 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.721834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:09.722258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:09.866154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:09.874596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fe613593-6542-4913-a5b4-1951f1007e36 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.166538 Aug 27 03:33:09.875199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 361/760] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:09 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:10.311787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-270b9860-950b-4750-b440-fa1f2ff517fd req-ad1403b0-74af-4bb2-a75e-3f0b8e9ac64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffca0db-5614-4bf4-9dfd-82baf16ab054", "name": "network-vif-plugged", "status": "completed", "tag": "27f03c09-eef2-4905-81b1-c2bc4f2bc7fe"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:10.314022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:10.314022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:33:10.322366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-270b9860-950b-4750-b440-fa1f2ff517fd req-ad1403b0-74af-4bb2-a75e-3f0b8e9ac64e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.323578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-270b9860-950b-4750-b440-fa1f2ff517fd req-ad1403b0-74af-4bb2-a75e-3f0b8e9ac64e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.339885 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-270b9860-950b-4750-b440-fa1f2ff517fd req-ad1403b0-74af-4bb2-a75e-3f0b8e9ac64e service nova] Creating event network-vif-plugged:27f03c09-eef2-4905-81b1-c2bc4f2bc7fe for instance 2ffca0db-5614-4bf4-9dfd-82baf16ab054 on hv-cinder-80473 Aug 27 03:33:10.345347 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-270b9860-950b-4750-b440-fa1f2ff517fd req-ad1403b0-74af-4bb2-a75e-3f0b8e9ac64e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037163 Aug 27 03:33:10.346490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 400/761] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:10.394500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.394500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.400517 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.401198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.401819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.402248 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.552829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.561253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-016a3bb8-497e-4fe3-8701-30db6f5add7d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.172345 Aug 27 03:33:10.562089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 362/762] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:10 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:10.896238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.897486 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:10.908229 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.908950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:10.910189 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:10.910894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.046831 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.059259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-217e88dc-d7a9-4e35-8870-eff8c7a6e484 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1319 microversion: 2.1 time: 0.170155 Aug 27 03:33:11.059838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 401/763] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:10 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.582020 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.583026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:11.594055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.594821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.596098 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:11.596774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:11.730258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.738078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c4a02b1d-4b7d-4ff3-8b93-409d5b524245 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.162487 Aug 27 03:33:11.738616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 363/764] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:11 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.077011 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.078386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.084647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.085281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.086053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.086484 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.211787 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.223377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-654070fa-c6c1-4ac2-a49c-1798efb93ef2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1508 microversion: 2.1 time: 0.150685 Aug 27 03:33:12.224238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 402/765] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:12 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.240303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88c11a9b-3a18-4f40-bc6d-b726938262ee", "device": "/dev/sdb"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:12.241488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.247500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.247939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.248693 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.249116 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.498652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cfea4697-e85f-40fc-a978-13bbff5103c7 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "POST /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262047 Aug 27 03:33:12.499467 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 364/766] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:33:12 2021] POST /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:12.756496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.757140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:12.764839 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.765381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.766307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:12.766828 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:12.898587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.906777 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-17ab903b-18f1-4c8c-8a7f-39d7d96c3ebb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.155144 Aug 27 03:33:12.907395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 403/767] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:12 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.925543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.927231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:13.934836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.935282 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:13.936138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:13.936575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:14.065828 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.074024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-41385035-7877-4529-8bf9-5af9fff1a82a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.153164 Aug 27 03:33:14.074581 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 365/768] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:13 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.090505 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.091099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:15.097205 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.097650 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.098416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:15.098815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:15.229202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.237317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f83b1b94-028c-41fd-891b-856281a1ce5d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.150667 Aug 27 03:33:15.237893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 404/769] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:15 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.255314 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.255976 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:16.262856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.263297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.264093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:16.264516 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:16.404436 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.412494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8e85a223-8e96-4105-8003-4aca0f369a36 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.160968 Aug 27 03:33:16.413055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 366/770] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:16 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.430910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.431539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:17.438830 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.441488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.442150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:17.442583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:17.583923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.592851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-993a7a03-d8f1-4954-a71c-2c404cdf3b80 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.166600 Aug 27 03:33:17.593419 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 405/771] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:17 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.609892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.610462 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:18.617740 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.618485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.619491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:18.620408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:18.760485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.768181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9e9e33ed-c250-449d-beb1-a0c740d5ffcb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.162009 Aug 27 03:33:18.768739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 367/772] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:18 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.789240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.790236 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:19.797296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.797772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.798537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:19.798989 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:19.927812 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.937527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1f4ef4ec-f72d-4cc6-901f-29b58e16cdfa tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.154386 Aug 27 03:33:19.938113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 406/773] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:19 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.958323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.959342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:20.967644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.968056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:20.968808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:20.969230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:21.108559 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.120841 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-acbe704d-a3f6-41b2-bd00-1671fff3bcbb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.168360 Aug 27 03:33:21.121666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 368/774] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:20 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:22.147460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.148082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:22.157413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.157973 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.159096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:22.159729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:22.282355 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:22.290588 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b469f890-c3ce-4e33-9369-6dbcde9bab4d tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.149282 Aug 27 03:33:22.291159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 407/775] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:22 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:23.312798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.313787 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:23.324542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.325280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.326250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:23.326741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:23.457824 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.469981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a6d6c0c1-9c16-42f0-83f1-668fd0d7838c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.163517 Aug 27 03:33:23.470618 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 369/776] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:23 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.222977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.223731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:24.234020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.234477 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.235274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.235826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.326824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lazy-loading 'services' on Instance uuid b798f8be-ccdf-4eec-b4dc-9216b13eba31 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:24.399274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-97eabb7b-1ee9-4cda-90ee-7b59ab383900 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments/43f7de90-aefd-4f63-a595-a44d6e364af1" status: 202 len: 0 microversion: 2.1 time: 0.180793 Aug 27 03:33:24.399905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 408/777] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:33:24 2021] DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments/43f7de90-aefd-4f63-a595-a44d6e364af1 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:24.487233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.488076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:24.493816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.494262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.495034 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:24.495484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:24.713880 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.722734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cbd7bad3-a1c0-4f59-ae0c-cb377b5efc31 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.239379 Aug 27 03:33:24.723287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 370/778] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:24 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:25.742245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.742921 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:25.749454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.749869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.750665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:25.751176 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:25.894668 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:25.902805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-007b79ca-f1b7-4351-8a33-bd0ce274ebdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.165813 Aug 27 03:33:25.903372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 409/779] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:25 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.584923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-54b615e0-18ce-4c81-b7fc-fdd9b8d57bca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:26.591461 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54b615e0-18ce-4c81-b7fc-fdd9b8d57bca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.591894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-54b615e0-18ce-4c81-b7fc-fdd9b8d57bca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.655870 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-54b615e0-18ce-4c81-b7fc-fdd9b8d57bca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Going to try to stop instance {{(pid=108335) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 03:33:26.701866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-54b615e0-18ce-4c81-b7fc-fdd9b8d57bca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 202 len: 0 microversion: 2.1 time: 0.120501 Aug 27 03:33:26.702891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 371/780] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:26 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:26.712284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.712884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:26.719134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.719641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.720467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.721019 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.850684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.861490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aad80dff-1dda-4851-a2fe-3bdc9cf20137 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.153025 Aug 27 03:33:26.862668 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 410/781] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:26 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.920295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.920988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:26.928398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.928846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:26.929608 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:26.930035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.059905 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.068666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-22cb61b9-01d3-4466-886f-9fb1b6cf4aa9 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.152555 Aug 27 03:33:27.069226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 372/782] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:26 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:27.884631 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:27.885613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:27.895981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.896796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:27.897568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:27.898018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.024159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.033873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8b731974-c08b-402b-826c-6ae6ab6191ac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.155877 Aug 27 03:33:28.034799 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 411/783] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:27 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:28.085904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.086488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:28.092861 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.093301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.094060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:28.094484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:28.230427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.242615 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7fbc8d2f-a898-4077-a8f9-10308854bcca tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.160275 Aug 27 03:33:28.243369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 373/784] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:28 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:29.052476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.053434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:29.059781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.060222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.060985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.061407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.192650 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.204731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5aa1334d-73f1-474f-9e0e-41e106daaa53 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.155644 Aug 27 03:33:29.205483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 412/785] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:29 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:29.260157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.260818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:29.267810 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.268270 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.269060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:29.269482 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:29.407502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.416445 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2ed73511-aff0-4c71-8b43-33bcbad44ebc tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.160142 Aug 27 03:33:29.416965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 374/786] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:29 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:30.225756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.226335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:30.233133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.233580 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.234339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.234794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.367814 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.375928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9ea53423-0497-4024-b73d-dbb85e3d8e80 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.153745 Aug 27 03:33:30.376413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 413/787] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:30 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:30.434511 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.435114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:30.441483 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.441943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.442719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:30.443151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:30.580596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.589537 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1840292c-3f50-435d-be50-fc9809bb0638 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.158906 Aug 27 03:33:30.590184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 375/788] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:30 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.395017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.395863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.404298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.404748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.405516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.405946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.540049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.548059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-16cc199a-a40e-40de-88bd-8d31ec043ec8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.157905 Aug 27 03:33:31.548635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 414/789] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.619845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.620965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:31.631330 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.632075 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.633212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:31.633886 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:31.763715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.775303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b2ea9457-c88b-4186-b8aa-2bd4f357c349 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1567 microversion: 2.1 time: 0.163677 Aug 27 03:33:31.775909 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 376/790] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:31 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:32.566464 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.567051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.573476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.573914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.574689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.575107 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.711018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.719261 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ed5699c2-dff2-4423-ac73-889e9100ddb4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.156774 Aug 27 03:33:32.719909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 415/791] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:32 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.796383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.797480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.807932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.808373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.809143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.809573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.895845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.896560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.902685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.903371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.904246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.904672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.940534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.949123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-17ca57c7-7beb-4164-8a1e-2bc82c1d136a tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1547 microversion: 2.1 time: 0.159189 Aug 27 03:33:32.949689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 377/792] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:32 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.965053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.965536 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:32.971372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.971822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.972613 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:32.973041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:32.993761 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lazy-loading 'services' on Instance uuid 2ffca0db-5614-4bf4-9dfd-82baf16ab054 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:33.068562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] HTTP exception thrown: Cannot 'detach_volume' instance f95f90b2-f020-440a-81cf-5e339f032c8b while it is in vm_state rescued Aug 27 03:33:33.069154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Returning 409 to user: Cannot 'detach_volume' instance f95f90b2-f020-440a-81cf-5e339f032c8b while it is in vm_state rescued {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:33.069983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3e9e6efa-4e88-4930-9e80-b99caaba2379 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments/eeeb90e6-9ac6-4d5c-8c74-7656b0b1f92b" status: 409 len: 152 microversion: 2.1 time: 0.108715 Aug 27 03:33:33.070552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 378/793] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:33:32 2021] DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments/eeeb90e6-9ac6-4d5c-8c74-7656b0b1f92b => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:33:33.074121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-080a0acf-a6ae-4169-b6b6-c432850bd0c1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054/os-volume_attachments/88c11a9b-3a18-4f40-bc6d-b726938262ee" status: 202 len: 0 microversion: 2.1 time: 0.182932 Aug 27 03:33:33.074121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 416/794] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:33:32 2021] DELETE /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054/os-volume_attachments/88c11a9b-3a18-4f40-bc6d-b726938262ee => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:33.080131 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:33.081142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.089514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.089834 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.090706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.091229 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.174944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-60ddb107-c49c-4f88-a71f-00aad8870120 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.098982 Aug 27 03:33:33.178203 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 417/795] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:33 2021] POST /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:33:33.186403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.187302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.193414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.193864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.194847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.195065 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.640236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.648391 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cfd650e6-ff3d-4e24-9f54-bf747c196077 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1555 microversion: 2.1 time: 0.467485 Aug 27 03:33:33.652796 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 379/796] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1555 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:33.737843 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.738569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:33.745358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.745824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.746648 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:33.747091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:33.962917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.970824 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aeaa81fd-0094-48e6-815d-0a550e3c0881 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.237191 Aug 27 03:33:33.974176 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 418/797] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:33 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.667376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.668003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:34.674861 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.675387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.676369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.676778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:34.813953 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.826357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7717efb3-f609-4445-9ef0-5690d7684bdd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1555 microversion: 2.1 time: 0.163323 Aug 27 03:33:34.826930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 380/798] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:34 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.990572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.991462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:34.998866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:34.999307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.000109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.000540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.142476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.150920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e496f75e-94be-49b0-a448-7229ad952596 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.165738 Aug 27 03:33:35.151552 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 419/799] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:34 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.270926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.271518 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.278362 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.278805 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.279610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.280037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.305903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:33:35.386629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6f0a4407-c4a1-42c0-876a-de612eef35d2 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 204 len: 0 microversion: 2.1 time: 0.119060 Aug 27 03:33:35.387456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 381/800] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:33:35 2021] DELETE /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:35.395901 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.396595 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.402705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.403153 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.403916 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.404376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.533137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.545345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-34df4c72-0f4e-484f-8570-cb102d65c1cc tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1514 microversion: 2.1 time: 0.153167 Aug 27 03:33:35.546034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 420/801] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:35.848487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.849684 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:35.858117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.858555 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.859316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:35.859816 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:35.982640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.990501 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-833c305e-11b5-4f0b-ae66-616d418144c8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1555 microversion: 2.1 time: 0.149135 Aug 27 03:33:35.991063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 382/802] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:35 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:36.168844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.169485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:36.176018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.176491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.177262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.177691 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.320088 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.332371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1d43f9b5-6d92-4ac2-8eca-988cd0991a15 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.167176 Aug 27 03:33:36.333463 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 421/803] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:36 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:36.563395 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.564027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:36.571698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.572435 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.573385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:36.573845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:36.716928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.728414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d007588d-9d15-43f8-bec9-4dfe1f934d39 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1514 microversion: 2.1 time: 0.168541 Aug 27 03:33:36.729201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 383/804] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:36 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:37.011160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.012168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.021556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.022243 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.023510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.024256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.158011 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.166490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e488252f-31fd-4e3d-b872-726545744760 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1561 microversion: 2.1 time: 0.161349 Aug 27 03:33:37.167535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 422/805] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:37.240704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.241236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.247374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.247820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.248592 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.249005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.335280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lazy-loading 'services' on Instance uuid f95f90b2-f020-440a-81cf-5e339f032c8b {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:37.350813 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.351515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.357858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.358307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.359067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.359522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.415827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5d63926c-ca0d-4c98-8f9f-22bdb04c123c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments/eeeb90e6-9ac6-4d5c-8c74-7656b0b1f92b" status: 202 len: 0 microversion: 2.1 time: 0.178586 Aug 27 03:33:37.416469 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 384/806] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:33:37 2021] DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments/eeeb90e6-9ac6-4d5c-8c74-7656b0b1f92b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:33:37.425471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.426950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.434344 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.434794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.435597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.436013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.468771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ffea6225-b5c3-453b-b8cd-a81dde67c13e tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047376 Aug 27 03:33:37.469707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 385/807] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:37.492500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.500554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aae3963e-1557-485f-a49c-a22a9de15a0e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.153465 Aug 27 03:33:37.501135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 423/808] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:37.750847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.751485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:37.757679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.758117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.758871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:37.759324 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:37.888756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.898592 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8769c686-56f3-4c95-bee1-f9a6c31eeed1 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1514 microversion: 2.1 time: 0.151324 Aug 27 03:33:37.899527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 386/809] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:37 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:38.481168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.483249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.492115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.492619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.493628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.494060 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.517497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.518656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.525514 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.526079 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.526826 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.527342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.529697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3c5eee03-cdad-4e5b-a0e7-75d36aca32c5 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053557 Aug 27 03:33:38.530491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 424/810] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:33:38.578841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-20c05c19-8204-4691-b8e7-c1fd20bfa352 req-f837c321-7d86-4a39-8d04-002f9056e0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffca0db-5614-4bf4-9dfd-82baf16ab054", "name": "network-vif-deleted", "tag": "27f03c09-eef2-4905-81b1-c2bc4f2bc7fe"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:38.583587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:38.583587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:33:38.606314 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-20c05c19-8204-4691-b8e7-c1fd20bfa352 req-f837c321-7d86-4a39-8d04-002f9056e0e8 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.606942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-20c05c19-8204-4691-b8e7-c1fd20bfa352 req-f837c321-7d86-4a39-8d04-002f9056e0e8 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.632710 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-20c05c19-8204-4691-b8e7-c1fd20bfa352 req-f837c321-7d86-4a39-8d04-002f9056e0e8 service nova] Creating event network-vif-deleted:27f03c09-eef2-4905-81b1-c2bc4f2bc7fe for instance 2ffca0db-5614-4bf4-9dfd-82baf16ab054 on hv-cinder-80473 Aug 27 03:33:38.657823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-20c05c19-8204-4691-b8e7-c1fd20bfa352 req-f837c321-7d86-4a39-8d04-002f9056e0e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088464 Aug 27 03:33:38.658878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 425/811] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:38.689504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.699632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7347a47c-13cc-46f6-8fe1-07482ed912a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.185766 Aug 27 03:33:38.701311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 387/812] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:38.918621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.919425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:38.926013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.926461 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.927528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.928321 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.963737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:38.964201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:38.964696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lazy-loading 'fault' on Instance uuid 2ffca0db-5614-4bf4-9dfd-82baf16ab054 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:33:39.010188 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faa1a83294641068232fe1b173af45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd6a8224c1149f6a978d9174fa5a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.018169 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e0786269-8dc1-4d68-8b82-f86bc4c0a048 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 200 len: 1309 microversion: 2.1 time: 0.105232 Aug 27 03:33:39.027402 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 426/813] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:38 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:39.719701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:39.720346 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:39.726606 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.727038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.727841 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:39.728275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:39.854838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:39.862413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-19b96f11-d9c9-4290-ad36-992c542a0b7d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.147754 Aug 27 03:33:39.862922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 388/814] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:39 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:40.036444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.037079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] [instance: 2ffca0db-5614-4bf4-9dfd-82baf16ab054] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.043962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.044603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.045237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.045678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.060716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] HTTP exception thrown: Instance 2ffca0db-5614-4bf4-9dfd-82baf16ab054 could not be found. Aug 27 03:33:40.061303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] Returning 404 to user: Instance 2ffca0db-5614-4bf4-9dfd-82baf16ab054 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:40.062128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8d66fabb-06dc-4e8e-be9a-c5381a68c834 tempest-VolumesSnapshotTestJSON-1729688188 tempest-VolumesSnapshotTestJSON-1729688188-project] 10.222.0.58 "GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054" status: 404 len: 111 microversion: 2.1 time: 0.029632 Aug 27 03:33:40.062674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 427/815] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:40 2021] GET /compute/v2.1/servers/2ffca0db-5614-4bf4-9dfd-82baf16ab054 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:40.880212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.880794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.887264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.887709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.888461 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.889083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.908859 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.909349 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:40.915133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.915895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.916392 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:40.917451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:40.945713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:33:41.028881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.037866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0e67b4d0-fe5e-4fc0-9cd7-e792667eecab tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.160794 Aug 27 03:33:41.038610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 389/816] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:40 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:41.040063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-78885d7d-c585-4536-b478-be5e9af3a2eb tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "DELETE /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 204 len: 0 microversion: 2.1 time: 0.134573 Aug 27 03:33:41.041394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 428/817] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:33:40 2021] DELETE /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:41.051240 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.052036 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:41.058809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.059279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.060088 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:41.060552 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:41.182446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.189667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-989edbf6-a97a-4bb6-82f0-7f1f3ffda3b4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1507 microversion: 2.1 time: 0.142964 Aug 27 03:33:41.190548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 390/818] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:41 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1507 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:42.057239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.058305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.064497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.064944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.065747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.066366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.191825 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.201018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5f1b11f7-c534-4cd0-8b1a-b03469f02efd tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.147569 Aug 27 03:33:42.201501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 429/819] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:42 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:42.206911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.208263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:42.214576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.214979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.215831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:42.216310 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:42.340782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.348360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2359f802-a5b2-46e8-b6da-6c48791d6835 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1507 microversion: 2.1 time: 0.145421 Aug 27 03:33:42.348995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 391/820] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:42 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:43.217741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:43.218354 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:43.230847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.231549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.232511 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.233212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.365745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:43.366392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:43.374684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.376634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.377032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.377860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:43.378285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:43.382306 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-40e1734c-e21b-4701-86e4-04cdee4d33bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.168564 Aug 27 03:33:43.382873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 430/821] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:43 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:43.507837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.515547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4cc1bed6-7d0e-4e37-ba8c-32cab3813b98 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1507 microversion: 2.1 time: 0.153670 Aug 27 03:33:43.516161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 392/822] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:43 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:44.402616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.403216 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:44.409949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.410388 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.411150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.411615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.532300 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.532912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:44.539657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.540032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.540869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:44.541342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:44.550773 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:44.559378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5c1b4bf0-c099-45af-85a7-db48db53b2bc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.162433 Aug 27 03:33:44.560364 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 431/823] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:44 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:44.670308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:44.678708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0aa9f993-371b-40d2-9a4a-c407f448be84 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1507 microversion: 2.1 time: 0.150117 Aug 27 03:33:44.679498 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 393/824] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:44 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.576500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:45.577123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:45.583325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.583970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.584695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.585206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.698661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:45.700137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:45.709057 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.709630 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.710669 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.711195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.822813 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.834986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.854857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-579e799f-5c6c-46ff-b9be-a8c42ad8ee41 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.282175 Aug 27 03:33:45.855837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-152145dc-303b-41e8-93f6-476b79fe136b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 200 len: 1465 microversion: 2.1 time: 0.159442 Aug 27 03:33:45.856647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 394/825] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:45 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.856931 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 432/826] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:45 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:45.909487 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-36b7cf8f-dc49-4d8d-a62a-9ee7f0cd5360 req-6b32a671-fd13-484e-ae33-f2813cffa7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b109c-444e-4971-99e3-59d4d3993ff3", "name": "network-vif-deleted", "tag": "3a9cae7d-f3bd-41ea-856e-afad4fd8420a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:45.911666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:45.911666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:33:45.920125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-36b7cf8f-dc49-4d8d-a62a-9ee7f0cd5360 req-6b32a671-fd13-484e-ae33-f2813cffa7ee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:45.920559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-36b7cf8f-dc49-4d8d-a62a-9ee7f0cd5360 req-6b32a671-fd13-484e-ae33-f2813cffa7ee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:45.938150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-36b7cf8f-dc49-4d8d-a62a-9ee7f0cd5360 req-6b32a671-fd13-484e-ae33-f2813cffa7ee service nova] Creating event network-vif-deleted:3a9cae7d-f3bd-41ea-856e-afad4fd8420a for instance 812b109c-444e-4971-99e3-59d4d3993ff3 on hv-cinder-80473 Aug 27 03:33:45.946531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-36b7cf8f-dc49-4d8d-a62a-9ee7f0cd5360 req-6b32a671-fd13-484e-ae33-f2813cffa7ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042579 Aug 27 03:33:45.947750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 433/827] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:46.876653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.877323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: 812b109c-444e-4971-99e3-59d4d3993ff3] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.880854 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.881602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.884231 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.884731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.885535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.885978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.888401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.888864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.889642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.890102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.900161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] HTTP exception thrown: Instance 812b109c-444e-4971-99e3-59d4d3993ff3 could not be found. Aug 27 03:33:46.900773 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Returning 404 to user: Instance 812b109c-444e-4971-99e3-59d4d3993ff3 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:33:46.901634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-01ea17e0-ca9c-47f0-a39b-8c64c5f08c06 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3" status: 404 len: 111 microversion: 2.1 time: 0.030685 Aug 27 03:33:46.902930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 395/828] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers/812b109c-444e-4971-99e3-59d4d3993ff3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:46.912194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.912689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:46.919713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.920158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.920977 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:46.921411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:46.950058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:33:47.025636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:47.034267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2ff0b2eb-bae6-4610-8b55-d6037ce6b0c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.157517 Aug 27 03:33:47.035435 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 434/829] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:46 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:47.039603 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ac0b35a9-34bc-4f5a-a174-ca0c2899c5f8 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 204 len: 0 microversion: 2.1 time: 0.132194 Aug 27 03:33:47.040422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 396/830] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:33:46 2021] DELETE /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:47.048376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:47.048974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:47.055266 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.055757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.056522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:47.056943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:47.190605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:47.198036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7e7bad55-725c-4ea6-8457-df54eed69068 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.153501 Aug 27 03:33:47.198583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 435/831] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:47 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.058327 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.059304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:48.066211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.066651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.067438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.067865 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.200145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.209129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b0082de5-d420-464f-9c32-5594418a10d3 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.158047 Aug 27 03:33:48.209829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 397/832] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:48 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.215326 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.215952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:48.222568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.223089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.223986 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:48.224411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:48.373275 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.381708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4e48abd3-c2be-4e4d-86c6-511dc1722c2b tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.170019 Aug 27 03:33:48.382300 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 436/833] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:48 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:49.227585 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.228306 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.236476 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.236992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.237871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.238366 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.371954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:49.381404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5067c99c-566e-4920-b50d-438ac18a84d7 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1678 microversion: 2.1 time: 0.158155 Aug 27 03:33:49.382166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 398/834] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:49 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:49.397698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.398430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:49.404137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.404712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.405478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:49.405898 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:49.537101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:49.547442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fb9d1097-89af-4d73-84d0-88218286259c tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.153211 Aug 27 03:33:49.548024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 437/835] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:49 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.399398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.400189 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.407466 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.407914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.408668 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.409061 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.542428 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.550342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5444b3aa-d3bd-461b-a1de-7a979137a5d1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1655 microversion: 2.1 time: 0.155609 Aug 27 03:33:50.550943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 399/836] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:50 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.565297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.566016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.566960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-808111b6-3b0e-4fd2-a0ba-52a9d897ae37 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:50.572469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.572820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-808111b6-3b0e-4fd2-a0ba-52a9d897ae37 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.572987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.573265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-808111b6-3b0e-4fd2-a0ba-52a9d897ae37 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.573678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.574100 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.596850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-808111b6-3b0e-4fd2-a0ba-52a9d897ae37 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Going to try to start instance {{(pid=108335) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 03:33:50.651700 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-808111b6-3b0e-4fd2-a0ba-52a9d897ae37 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action" status: 202 len: 0 microversion: 2.1 time: 0.087783 Aug 27 03:33:50.652402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 400/837] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:33:50 2021] POST /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:33:50.663029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.668345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:50.675460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.676272 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.676995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:50.677449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:50.703495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.711243 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-24ec0aed-8304-417d-b988-cb04e2257560 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.149793 Aug 27 03:33:50.712016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 438/838] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:50 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.813897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.821548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ca6006e6-8d59-4aa2-ba01-956e7399f5e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.164641 Aug 27 03:33:50.822252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 401/839] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:50 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:51.730587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:51.731404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:51.737705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.738141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.738886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.739305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.840357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:51.841080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:51.847255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.847798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.848623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:51.849137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:51.874637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.882667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b7a7d6ff-7fb6-4ff0-9637-92d4d0a8f6ee tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.157038 Aug 27 03:33:51.883214 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 439/840] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:51 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:51.976527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.983819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d1ce865e-4db8-4c2f-a2e8-aded5f36e4e1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.147570 Aug 27 03:33:51.984392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 402/841] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:51 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:52.902371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:52.903003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:52.910196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.910659 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:52.911483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:52.911930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.001456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:53.002056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:53.010258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.010700 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.011894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:53.011894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:53.053352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:53.060851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d0a90041-5677-475a-95cb-0ca3fc203dcd tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.162402 Aug 27 03:33:53.061409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 440/842] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:52 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:53.142574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:53.153727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-42b7d3f7-96fb-4398-b581-3fb708fc663e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.156083 Aug 27 03:33:53.154437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 403/843] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:52 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:54.077950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.078533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.084656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.085071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.085836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.086263 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.176396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.177236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:54.183713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.184362 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.186278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:54.186691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:54.223561 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.232146 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c71ff564-08a6-4e63-8c01-01dd3db94634 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.157414 Aug 27 03:33:54.233312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 441/844] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:54 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:54.325874 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.333404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-072445f2-aa6f-44b0-8b2c-e3e6b145ae55 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.160616 Aug 27 03:33:54.333972 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 404/845] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:54 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:55.253737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.254670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.264818 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.265215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.265989 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.266421 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.350411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.351074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:55.357802 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.358253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.359338 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:55.360066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:55.446340 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.454427 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1fa6ccf0-7874-4f43-9cc3-f5f8b516349f tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.207256 Aug 27 03:33:55.455021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 442/846] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:55 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:55.506522 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.519174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d509bc2d-6ce8-4cc3-b59f-0da4c38ae92d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.172374 Aug 27 03:33:55.520302 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 405/847] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:55 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.476543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.477197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:56.487515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.488199 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.489280 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.490063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.541402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.541981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:56.548015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.548449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.549239 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:56.549845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:56.653487 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.661382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e7c8f10e-4e2e-448c-815f-564c46bb4c46 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.190849 Aug 27 03:33:56.661935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 443/848] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:56 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.703007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.711095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6857f83f-e09f-40af-88eb-306f0626e215 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1664 microversion: 2.1 time: 0.173528 Aug 27 03:33:56.711775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 406/849] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:56 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:57.679674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.680366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:57.687002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.687485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.688269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.688697 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.728082 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.728682 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:57.734810 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.735262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.736053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:57.736474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:57.845672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.853948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7c029651-81a1-48e1-ac4f-865839e97ae0 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.178716 Aug 27 03:33:57.854769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 444/850] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:57 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:57.898790 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.907263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c09b2549-e5eb-45e5-b935-df95f163f633 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1668 microversion: 2.1 time: 0.182829 Aug 27 03:33:57.907846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 407/851] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:57 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:58.877306 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.878086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:33:58.885231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.885677 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:58.886448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:58.887064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.067938 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-2b7a3fa9-11ce-4ff7-b10b-38197baa5c0f req-8086e931-8d55-4d7d-b966-d52d3617bdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95f90b2-f020-440a-81cf-5e339f032c8b", "name": "network-vif-deleted", "tag": "09d98d1e-1fdd-4a75-b401-02f9b781896d"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:59.069834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:33:59.069834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:33:59.082717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2b7a3fa9-11ce-4ff7-b10b-38197baa5c0f req-8086e931-8d55-4d7d-b966-d52d3617bdd7 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:33:59.083063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2b7a3fa9-11ce-4ff7-b10b-38197baa5c0f req-8086e931-8d55-4d7d-b966-d52d3617bdd7 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:33:59.095328 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8642de4a64b80b0a85d69663e2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec8900e772c45c583c5e85e9958d95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.095888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-2b7a3fa9-11ce-4ff7-b10b-38197baa5c0f req-8086e931-8d55-4d7d-b966-d52d3617bdd7 service nova] Creating event network-vif-deleted:09d98d1e-1fdd-4a75-b401-02f9b781896d for instance f95f90b2-f020-440a-81cf-5e339f032c8b on hv-cinder-80473 Aug 27 03:33:59.101383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-2b7a3fa9-11ce-4ff7-b10b-38197baa5c0f req-8086e931-8d55-4d7d-b966-d52d3617bdd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Aug 27 03:33:59.102026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 408/852] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:59.105425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-aedf98a2-3fbd-48a9-a26f-8ddd429e6c51 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 200 len: 1521 microversion: 2.1 time: 0.236951 Aug 27 03:33:59.105921 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 445/853] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:33:58 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:00.124745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.125441 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] [instance: f95f90b2-f020-440a-81cf-5e339f032c8b] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:00.131679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.132126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.132898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:00.133326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:00.146808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] HTTP exception thrown: Instance f95f90b2-f020-440a-81cf-5e339f032c8b could not be found. Aug 27 03:34:00.147427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] Returning 404 to user: Instance f95f90b2-f020-440a-81cf-5e339f032c8b could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:34:00.148325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fc135b1d-f971-4c5d-b288-6690912510a4 tempest-ServerRescueNegativeTestJSON-682618569 tempest-ServerRescueNegativeTestJSON-682618569-project] 10.222.0.58 "GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b" status: 404 len: 111 microversion: 2.1 time: 0.029504 Aug 27 03:34:00.148857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 409/854] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:00 2021] GET /compute/v2.1/servers/f95f90b2-f020-440a-81cf-5e339f032c8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:06.270124 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.271295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.277393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.279134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.279968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.282226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.326217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44d41c15-9140-434f-b4b2-394932332a03 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments/330cdf7c-f0f3-4edf-9fa2-c5cc274ce2e8" status: 200 len: 194 microversion: 2.20 time: 0.060286 Aug 27 03:34:06.327104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 446/855] 10.222.0.58 () {60 vars in 1454 bytes} [Fri Aug 27 03:34:06 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments/330cdf7c-f0f3-4edf-9fa2-c5cc274ce2e8 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:06.402199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.402687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.410273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.411316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.412447 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.412988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.507502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lazy-loading 'services' on Instance uuid 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:06.585851 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1cfc4089-750e-49c1-bff0-0a7aab0916ce tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments/330cdf7c-f0f3-4edf-9fa2-c5cc274ce2e8" status: 202 len: 0 microversion: 2.20 time: 0.187696 Aug 27 03:34:06.586655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 410/856] 10.222.0.58 () {60 vars in 1457 bytes} [Fri Aug 27 03:34:06 2021] DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments/330cdf7c-f0f3-4edf-9fa2-c5cc274ce2e8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:06.596123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.597030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:06.603434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.604137 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.605440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:06.605840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:06.652132 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ac498713-3cd1-4701-bd72-692040a1df23 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060257 Aug 27 03:34:06.652890 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 447/857] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Aug 27 03:34:06 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:07.667047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.669279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:07.678658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.679467 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.681063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.681989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.722972 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-73ebc190-7730-4ff1-97ab-fc7217740677 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061680 Aug 27 03:34:07.723765 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 411/858] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Aug 27 03:34:07 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:07.784725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.785322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:07.791030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.791555 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.792391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.792853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.818049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:34:07.897805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-04f8900d-e1e5-4fd2-8f8d-d116223e5780 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 204 len: 0 microversion: 2.20 time: 0.116399 Aug 27 03:34:07.898411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 448/859] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Aug 27 03:34:07 2021] DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:34:07.906596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.907185 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:07.913889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.914322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:07.915216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:07.915747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:08.047388 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.056376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.057858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.059093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c840d544-f413-436a-b156-50096e5ccc71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.156295 Aug 27 03:34:08.060397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 412/860] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:07 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:09.078734 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:09.079469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:09.085313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:09.085756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:09.086516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:09.086979 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:09.220343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.228483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.229953 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.231088 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-68a5b19d-ca8f-4ba9-a42f-c0baa44442de tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.156418 Aug 27 03:34:09.231681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 449/861] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:09 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:10.252452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.252996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:10.259957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:10.260429 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:10.261221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:10.261649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:10.390210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.398369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.400114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.401254 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-30b069e3-28d6-459e-a069-a72c55047423 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.155012 Aug 27 03:34:10.401824 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 413/862] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:10 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:11.426920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.427846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:11.434368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.435382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.436164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:11.436593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:11.747957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.756020 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.757475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.758590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c1663497-a02a-43e3-a25c-58629b7be12c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.335500 Aug 27 03:34:11.759145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 450/863] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:11 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:12.779131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.779830 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:12.785569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.786008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:12.786768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:12.787191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.276775 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.285168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.286682 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.287867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3332485f-8478-4165-9d67-2ca701ce19f3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1721 microversion: 2.20 time: 0.513416 Aug 27 03:34:13.288459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 414/864] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:12 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:13.903840 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-505af7cf-e993-473a-985a-e35599bb98e3 req-03195980-6e21-4c69-9361-896eeca0e5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b06c46a-59d4-4460-8c5c-8b1c0a34b987", "name": "network-vif-deleted", "tag": "53984622-e10d-4108-aa2f-8e507e1bd0bf"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:13.905429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:13.905429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:34:13.914005 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-505af7cf-e993-473a-985a-e35599bb98e3 req-03195980-6e21-4c69-9361-896eeca0e5d3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:13.914426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-505af7cf-e993-473a-985a-e35599bb98e3 req-03195980-6e21-4c69-9361-896eeca0e5d3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:13.925647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-505af7cf-e993-473a-985a-e35599bb98e3 req-03195980-6e21-4c69-9361-896eeca0e5d3 service nova] Creating event network-vif-deleted:53984622-e10d-4108-aa2f-8e507e1bd0bf for instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 on hv-cinder-80473 Aug 27 03:34:13.930829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-505af7cf-e993-473a-985a-e35599bb98e3 req-03195980-6e21-4c69-9361-896eeca0e5d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031390 Aug 27 03:34:13.931425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 451/865] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:14.307274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.308030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:14.314785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.315230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.316044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:14.316478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:14.462919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.471857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.473376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.474571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-049a9cbd-e8fd-4ac3-8da7-91428034d457 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1654 microversion: 2.20 time: 0.171078 Aug 27 03:34:14.475335 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 415/866] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:14 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:15.494509 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.495296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:15.502035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.502614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.503452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:15.503896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:15.570772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.579203 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.580749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.581872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b37787e6-4852-497e-a625-8d36d10f0c72 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1365 microversion: 2.20 time: 0.092005 Aug 27 03:34:15.582425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 452/867] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:15 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:16.601322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:16.602211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:16.612952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:16.613550 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:16.614571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:16.615141 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:16.687035 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.695055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.696623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.697830 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-90d0f992-24df-4b75-8c88-12d3fadf98aa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 200 len: 1365 microversion: 2.20 time: 0.101842 Aug 27 03:34:16.698372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 416/868] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:16 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:17.715864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.716617 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:17.723533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.723970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.724740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:17.725138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:17.739253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. Aug 27 03:34:17.739850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:34:17.740647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c59100f6-11fe-416a-84d2-efc098a419ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 404 len: 111 microversion: 2.20 time: 0.028637 Aug 27 03:34:17.741158 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 453/869] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:17 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:34:17.750590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0ae0d2da-b1c4-41f0-a39b-1c48fb2a7b3d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '.version_select at 0x7f6cfc346af0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.754740 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ae0d2da-b1c4-41f0-a39b-1c48fb2a7b3d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [6a74a8ab-f49e-4e34-9b56-388a1ee78fd2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:34:18.159987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:34:18.160162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:34:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:34:18.771725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [None req-0ae0d2da-b1c4-41f0-a39b-1c48fb2a7b3d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [6a74a8ab-f49e-4e34-9b56-388a1ee78fd2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 50962. Aug 27 03:34:18.794841 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0ae0d2da-b1c4-41f0-a39b-1c48fb2a7b3d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531314779" status: 204 len: 0 microversion: 2.20 time: 1.048212 Aug 27 03:34:18.795446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 417/870] 10.222.0.58 () {60 vars in 1259 bytes} [Fri Aug 27 03:34:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531314779 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:34:19.499446 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: .version_select at 0x7f6cfc29b9d0>, body: {"keypair": {"name": "tempest-keypair-39295384"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:19.518294 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:19.522322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:19.817429 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:19.821085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:19.833955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-55c3697d-4189-4392-828b-5850af00b6f6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.338431 Aug 27 03:34:19.834508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 454/871] 10.222.0.58 () {62 vars in 1199 bytes} [Fri Aug 27 03:34:19 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 340 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:34:21.253912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-897319382", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "914ec375-24a4-430c-b691-a84588d24cf3"}], "security_groups": [{"name": "tempest-securitygroup--1776256885"}], "key_name": "tempest-keypair-39295384", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:21.350825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] validate_networks() for [('914ec375-24a4-430c-b691-a84588d24cf3', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:34:21.778644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:21.779192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:21.779825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:21.780307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:21.780932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:21.790988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.791601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.792535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:21.793069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:21.813299 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:21.817598 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Getting quotas for user 75cb79bac8944976a2689f62b8d014e2 and project f60ccdbc7dbb46c6abacc312e57220a1. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:21.841202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:34:21.843680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:34:21.891087 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3f4ee096-99f5-4b16-9464-5e5d131fd422 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.641252 Aug 27 03:34:21.891778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 418/872] 10.222.0.58 () {62 vars in 1188 bytes} [Fri Aug 27 03:34:21 2021] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:34:21.909145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.909145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:21.961842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.970224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.971747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.972962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7ac71511-263c-41e9-8059-e24e00c35a71 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1279 microversion: 2.20 time: 0.074929 Aug 27 03:34:21.973710 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 455/873] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:21 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1279 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:22.990500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.991100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:22.998431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:22.998879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:22.999664 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:23.000189 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:23.069495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.079659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.081149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.082431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9bb1887c-228d-41a2-9a8e-324ffcb99fa3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1331 microversion: 2.20 time: 0.095906 Aug 27 03:34:23.083167 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 419/874] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:22 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:24.101134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.101704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:24.107845 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.108268 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.109061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.109478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.291926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.301568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.303387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.304737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1f83665e-6bba-46db-95eb-14440de0964a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.207670 Aug 27 03:34:24.305311 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 456/875] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:24 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:24.636208 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-1409b9ca-c8f2-4724-80bc-469f8b521ddb req-2e1a774a-3edf-4bf9-a5b6-30c4c144877c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:24.638612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:24.638612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:34:24.646973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-1409b9ca-c8f2-4724-80bc-469f8b521ddb req-2e1a774a-3edf-4bf9-a5b6-30c4c144877c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:24.647609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-1409b9ca-c8f2-4724-80bc-469f8b521ddb req-2e1a774a-3edf-4bf9-a5b6-30c4c144877c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:24.664913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-1409b9ca-c8f2-4724-80bc-469f8b521ddb req-2e1a774a-3edf-4bf9-a5b6-30c4c144877c service nova] Creating event network-changed:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:34:24.680946 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-1409b9ca-c8f2-4724-80bc-469f8b521ddb req-2e1a774a-3edf-4bf9-a5b6-30c4c144877c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041139 Aug 27 03:34:24.682127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 420/876] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:25.323807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.324750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:25.331278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.331728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.332499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:25.332925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:25.618150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.627808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.629283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.630418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1b6a8e4a-6566-4a18-9ef1-1fec0b7946f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.310655 Aug 27 03:34:25.630999 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 457/877] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:25 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:26.649610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.650232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:26.659239 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.659835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.660627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.661060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.805134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.814190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.816170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.817464 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-265fe9ac-6b52-4f5f-af47-308a25010fb0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.172339 Aug 27 03:34:26.818205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 421/878] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:26 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:27.837249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.838451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:27.844788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.845303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.846257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.846762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.991007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:28.000646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:28.002254 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:28.003468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d24a39c7-83c3-48a6-81fe-592414b827ac tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.170671 Aug 27 03:34:28.004118 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 458/879] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:27 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:28.882871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-dfa27d72-bd10-4840-9eb6-9cedbcbe08f5 req-c900bb3e-4ab7-4b59-a86d-48f4285c25b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "name": "network-vif-plugged", "status": "completed", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:28.884495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:28.884495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:34:28.891718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-dfa27d72-bd10-4840-9eb6-9cedbcbe08f5 req-c900bb3e-4ab7-4b59-a86d-48f4285c25b3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:28.892155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-dfa27d72-bd10-4840-9eb6-9cedbcbe08f5 req-c900bb3e-4ab7-4b59-a86d-48f4285c25b3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:28.902906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-dfa27d72-bd10-4840-9eb6-9cedbcbe08f5 req-c900bb3e-4ab7-4b59-a86d-48f4285c25b3 service nova] Creating event network-vif-plugged:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:34:28.908290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-dfa27d72-bd10-4840-9eb6-9cedbcbe08f5 req-c900bb3e-4ab7-4b59-a86d-48f4285c25b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029051 Aug 27 03:34:28.908891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 422/880] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:29.029730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:29.030436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:29.041952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:29.042408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:29.043194 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:29.043822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:29.326579 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.335778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.338157 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.339521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d26d10b2-7ec1-4ee6-986a-605f4f4ad9a1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.315140 Aug 27 03:34:29.351798 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 459/881] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:29 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:30.359205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:30.360717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:30.368682 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:30.369794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:30.370955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:30.372652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:30.588138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.602304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.604378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.606196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9dc19ac2-d18b-405d-9464-d8cee35fa6b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1405 microversion: 2.20 time: 0.252152 Aug 27 03:34:30.607242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 423/882] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:30 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:31.626796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.628339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.635539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.636090 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.636927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.637614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.859666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.883015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.886061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.887587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fd6afa16-6eb9-46f5-be9f-686ef7723478 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1597 microversion: 2.20 time: 0.266330 Aug 27 03:34:31.889253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 460/883] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:34:31 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1597 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:31.910640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.911831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:31.922461 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.924497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:31.927778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:31.931903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:32.148852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2a927a22-3224-41dc-a8e2-2a72fc310692 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.242301 Aug 27 03:34:32.149636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 424/884] 10.222.0.58 () {60 vars in 1316 bytes} [Fri Aug 27 03:34:31 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:33.496826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:33.498701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:33.506133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.506757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.513005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-5d3f304b-e247-4d0b-877e-204acdde1b1e req-e5a084b4-8ab4-4a12-b1ac-299ddbee6451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:33.516014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:34:33.516014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:34:33.520971 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.522695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.531869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-5d3f304b-e247-4d0b-877e-204acdde1b1e req-e5a084b4-8ab4-4a12-b1ac-299ddbee6451 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:33.532499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-5d3f304b-e247-4d0b-877e-204acdde1b1e req-e5a084b4-8ab4-4a12-b1ac-299ddbee6451 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:33.559042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-5d3f304b-e247-4d0b-877e-204acdde1b1e req-e5a084b4-8ab4-4a12-b1ac-299ddbee6451 service nova] Creating event network-changed:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:34:33.571546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-5d3f304b-e247-4d0b-877e-204acdde1b1e req-e5a084b4-8ab4-4a12-b1ac-299ddbee6451 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062002 Aug 27 03:34:33.576497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 425/885] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:34:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:33.613459 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-eea85a12-402e-4d52-b382-7158418cfec0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 0.120681 Aug 27 03:34:33.614050 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 461/886] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:33 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:34.626165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:34.627459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:34.642199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.642876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.645142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:34.650256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:34.734538 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d37bb439-c8d5-4c1b-abea-dd00169be784 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 0.113000 Aug 27 03:34:34.735619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 426/887] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:34 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:35.747044 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:35.751996 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:35.760372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.761075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:35.762607 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:35.763343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:37.951780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-11b5fcb1-15de-4d84-acca-95bb4bc5c081 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 2.209735 Aug 27 03:34:37.952433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 462/888] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:35 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:38.965202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:38.967963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:38.976735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.977171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:38.977940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:38.978361 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.349527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:40.350161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.358015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.358991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.359858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.360294 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.390662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lazy-loading 'flavor' on Instance uuid e25b26f8-5e31-4626-bda8-a9cec1e654fc {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:34:40.487490 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-974a1726-2583-48f2-93f2-f477c349d8ac tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "POST /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc/action" status: 202 len: 0 microversion: 2.1 time: 0.150516 Aug 27 03:34:40.488823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 463/889] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:34:40 2021] POST /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:40.498673 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.499695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:40.507233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.507700 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.508488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:40.508919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:40.711754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:40.726393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a3410b97-8813-47e7-bc30-2961276b8612 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.233177 Aug 27 03:34:40.727184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 464/890] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:40 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:41.144569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ec229704-7929-4892-8e7f-b35c42479e38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 2.185620 Aug 27 03:34:41.148074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 427/891] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:38 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:41.747593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.749355 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:41.758340 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.759123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:41.773059 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:41.773510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.027212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.037731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4911d2cc-3f3f-4f8d-9c2e-a00059a53e2b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.296874 Aug 27 03:34:42.047410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 465/892] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:41 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:42.157710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:42.159521 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:42.172769 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.173535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.174472 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:42.176913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:42.281561 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bb5a2e80-cb81-44c9-b496-97e8a991da81 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 0.128614 Aug 27 03:34:42.282334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 428/893] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:42 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.059471 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.062956 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.068988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.069469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.070923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.071593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.217723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:43.232440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f98571ac-2897-42e7-b891-85cb0aea1f49 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.177972 Aug 27 03:34:43.233670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 466/894] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:43 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.298621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:43.298621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:43.309887 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.311600 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.318534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:43.322924 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:43.461668 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-81ab74a5-c77d-49ba-82dd-1343e5572547 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 14 microversion: 2.20 time: 0.169638 Aug 27 03:34:43.462494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 429/895] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:43 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:44.250074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.250673 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.262883 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.263655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.264937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.265537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.473784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:44.474828 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:44.481750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.488041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.488512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.489503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:44.490091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:44.490218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-db60f128-5c0a-4ca8-9169-73d489ac2274 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.243999 Aug 27 03:34:44.500096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 467/896] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:44 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:44.611424 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b870257a-b3b6-4204-9352-ba5094c4903c tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 6451 microversion: 2.20 time: 0.141612 Aug 27 03:34:44.615044 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 430/897] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:44 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:45.506537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.507128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.515716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.516158 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.517023 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.517454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.622704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:45.623798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:45.631544 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.632555 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.633617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:45.634226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:45.725295 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4c77830e-e8a5-4489-aded-d98fc5335a1e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 13447 microversion: 2.20 time: 0.105330 Aug 27 03:34:45.727610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 431/898] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:45 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 13447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:45.909246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.916890 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f52ce524-9d05-456d-be58-8193c368ed30 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.413978 Aug 27 03:34:45.917661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 468/899] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:45 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.738539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:46.739827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.750013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.750578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.751493 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.752050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.846099 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a3250545-6d70-42b2-8422-0ae2b05d1dc7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 18398 microversion: 2.20 time: 0.111878 Aug 27 03:34:46.847123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 432/900] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:46 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 18398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:46.936295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.937708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:46.943640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.944297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:46.945286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:46.945705 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.093763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.104308 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-86100418-471d-4bce-bfad-15ccc7058a0a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.171337 Aug 27 03:34:47.104308 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 469/901] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:46 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:47.858794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:47.859830 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:47.866942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.867923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.868848 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:47.869291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:47.940755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5839df8f-be05-42c3-a7aa-4e043252ab7f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 19133 microversion: 2.20 time: 0.086169 Aug 27 03:34:47.941406 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 433/902] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:47 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 19133 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:48.121475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.122907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:48.136130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.136888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.138080 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.139087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.325565 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.336104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4dd2409f-0005-4af9-8311-faa4464cc83a tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.218567 Aug 27 03:34:48.337122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 470/903] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:48 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:48.953198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:48.954722 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:48.962239 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.962741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:48.963810 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:48.964454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.044160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c599d1ce-70c2-4693-a06b-87b7718868fe tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 21288 microversion: 2.20 time: 0.094943 Aug 27 03:34:49.044878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 434/904] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:48 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 21288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:49.356899 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.358142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:49.365447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.366067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.369893 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:49.370548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:49.538805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.548299 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bd9f5a41-a04f-49e0-8a1d-90d3f35bc4dd tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.195644 Aug 27 03:34:49.548879 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 471/905] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:49 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:49.679663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'create', calling method: .version_select at 0x7f6cfc2fe310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-638811788"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:49.698762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for project c24d36ba6b374775b93c113837910ba6. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:49.702960 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for user 8b241530f5bd4149a6dca50a1bd023e1 and project c24d36ba6b374775b93c113837910ba6. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:50.058968 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:50.059917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.066846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.067762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.069460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.070584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.089362 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for project c24d36ba6b374775b93c113837910ba6. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:50.094326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for user 8b241530f5bd4149a6dca50a1bd023e1 and project c24d36ba6b374775b93c113837910ba6. Resources: {'key_pairs'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:50.108784 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-70e3810e-9cbe-4999-8dca-ed74ea6ddd47 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.433626 Aug 27 03:34:50.109382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 435/906] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Aug 27 03:34:49 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:50.210154 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1258128873", "imageRef": "90972717-c4de-4708-ab33-69358702ed03", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-638811788", "networks": [{"uuid": "73bd44d6-ea8f-4165-8d6d-317f8321efd4"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:50.281178 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] validate_networks() for [('73bd44d6-ea8f-4165-8d6d-317f8321efd4', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:34:50.682978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:50.683725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:50.684686 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:50.685385 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:50.685976 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:50.697437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.697882 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.698677 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.699109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.717042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for project c24d36ba6b374775b93c113837910ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:50.721318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Getting quotas for user 8b241530f5bd4149a6dca50a1bd023e1 and project c24d36ba6b374775b93c113837910ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:50.732877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:34:50.735275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='90972717-c4de-4708-ab33-69358702ed03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:34:50.785698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-269c8f04-60fe-4f36-aac9-3413f5d0fb64 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579366 Aug 27 03:34:50.786708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 436/907] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:34:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:34:50.790971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.791608 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.798799 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.799236 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.800045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:50.800476 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:50.923895 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.932226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8da1f6e9-dcd7-4b8e-bdee-bc1ca96f2ec4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.144633 Aug 27 03:34:50.932887 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 437/908] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:50.938015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1e93f6cf-a458-48d2-9984-12f7263179ec tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.938622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1e93f6cf-a458-48d2-9984-12f7263179ec tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:50.997060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1e93f6cf-a458-48d2-9984-12f7263179ec tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.003889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1e93f6cf-a458-48d2-9984-12f7263179ec tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1258 microversion: 2.1 time: 0.069908 Aug 27 03:34:51.004554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 438/909] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:50 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:51.954168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.955151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:51.965447 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.965910 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:51.966752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:51.967169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.104198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.115100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a73ab8a1-c2c9-43f9-bdc1-fc4a02fa52be tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.167090 Aug 27 03:34:52.115883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 439/910] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:51 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:52.120075 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.120663 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:52.126446 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.126884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.127670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:52.128069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:52.187307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.194535 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-65ccff72-9360-46cc-abe9-e657fc927e71 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1262 microversion: 2.1 time: 0.077714 Aug 27 03:34:52.195092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 440/911] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:52 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:52.472585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a2d64b59-3d60-4a68-8b43-3ccb22b4aa74 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 25430 microversion: 2.20 time: 2.417670 Aug 27 03:34:52.473250 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 472/912] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:50 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 25430 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:53.133312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.133942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.140918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.141634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.142413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.142822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.212135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.212838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.219837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.220283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.221422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.221542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.303635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.312621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3236ea62-ffca-4359-b1e6-1d00b9533e20 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1328 microversion: 2.1 time: 0.104524 Aug 27 03:34:53.313186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 473/913] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:53 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.395967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.405307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f1956f44-9a12-41f6-a249-d8839b3a1a23 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.275652 Aug 27 03:34:53.406008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 441/914] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:53 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.484933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.486537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:53.493307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.494028 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.495038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:53.495722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:53.576603 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f4a1ad07-6b3e-49f1-af38-8816b9a843e8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 26581 microversion: 2.20 time: 0.095731 Aug 27 03:34:53.577433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 474/915] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:53 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 26581 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:54.330333 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.331057 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.346941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.347298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.348096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.348521 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.430375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.431636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.444022 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.446718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.447689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.448458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.583379 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.591639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5bd4da3b-8435-47bf-82a9-5a713789dc0d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.265313 Aug 27 03:34:54.592229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 442/916] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:54 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:54.601174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:54.602172 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:54.608423 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.608854 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.609625 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:54.610097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:54.640957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.649947 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d2d67d65-6175-4473-a7c6-c45142c7f864 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.230683 Aug 27 03:34:54.650883 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 475/917] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:54 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.609886 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.610888 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.619161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.620027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.621180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.622227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.777339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.788292 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-75a71463-8bba-4d09-85e0-c6b39ed98e1d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.182579 Aug 27 03:34:55.800024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 476/918] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.803233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.803529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:55.809963 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.810430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.811559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:55.812000 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:55.991794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:56.004365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-541593c3-e3a5-4afc-a1c1-2dd7ecf1bec9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.205712 Aug 27 03:34:56.005225 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 477/919] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:55 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:56.808346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.809987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:56.821601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.822301 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:56.823235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:56.823829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.004977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.012117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-359a9521-ba8e-4a77-800c-6663f5807396 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.207755 Aug 27 03:34:57.012867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 478/920] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:56 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.027529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.028462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:57.035370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.036109 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.037054 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:57.037643 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:57.206747 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.214271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f48c9aa1-63cd-4e86-8e6d-51a800145fd2 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.190793 Aug 27 03:34:57.214955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 479/921] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:57 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:58.029077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.029680 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:58.036247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.036689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.037452 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.037874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.181130 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.190746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-265cbaa5-59a9-403e-a11e-6e7b2a17c2dc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.165322 Aug 27 03:34:58.191905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 480/922] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:58 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:58.231474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.232184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:58.238755 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.239192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.240035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:58.240457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:58.378836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.389983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d0279e0e-c7af-4490-92ae-f5ae9cc96c1f tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.161998 Aug 27 03:34:58.390994 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 481/923] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:58 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:59.207635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:59.208524 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:59.214610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.215376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.216212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.216636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.347095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.354619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b4710801-d474-4974-b3f5-81a6c7f1ae37 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.150607 Aug 27 03:34:59.355180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 482/924] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:59 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:59.410874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:59.411744 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:34:59.422656 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.423096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.423911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:59.424336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:59.635783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.644218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-54b94203-7a99-4d42-a8c0-8b0737df3d28 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.236960 Aug 27 03:34:59.644790 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 483/925] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:34:59 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:00.374197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.374961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:00.381160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.381611 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.382377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.382806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.514383 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.521610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-17e32133-cf2c-41ff-8551-eef7bee9f613 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.152434 Aug 27 03:35:00.522166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 484/926] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:00 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:00.667242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.668701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:00.679847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.681142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.682533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:00.684154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:00.816219 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.823669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ea677291-df46-496e-b0fb-34b7a8c85794 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.163425 Aug 27 03:35:00.824434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 485/927] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:00 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:01.273079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.274017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.280587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.281145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.281976 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.282480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.317984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-70afcd81-ec06-4a3c-aa3c-21fd368c6d6e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048898 Aug 27 03:35:01.319294 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 486/928] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:35:01 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:35:01.388696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.389348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.395017 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.395553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.396320 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.396864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.426479 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:35:01.510448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-11aedf4f-1330-4b9a-b922-0a3eeefdfa10 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 204 len: 0 microversion: 2.1 time: 0.125258 Aug 27 03:35:01.511033 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 487/929] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:35:01 2021] DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:35:01.520838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.521631 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.535426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.536360 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.537548 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.538253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.706469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.716674 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-773091c2-32cb-4aad-9a5e-d06cb229a1e2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1674 microversion: 2.1 time: 0.200298 Aug 27 03:35:01.718038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 488/930] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:01 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:01.731202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.731959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.738284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.738841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.739856 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.740394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.899067 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.906474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1c8bda71-4422-4091-a7b6-6fa6711369bc tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.187127 Aug 27 03:35:01.907040 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 489/931] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:01 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:01.911318 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.911940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:01.920191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.920641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:01.921403 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:01.921832 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.049365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.057239 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-91dbcb06-4f47-4664-a238-0ff4a78b2494 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.149102 Aug 27 03:35:02.058063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 490/932] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:01 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.736262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.737134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:02.743270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.743726 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:02.744522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:02.744955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.126483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.134713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-16833058-5707-49ca-b0b7-87ded35be5b5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1674 microversion: 2.1 time: 0.401465 Aug 27 03:35:03.143388 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 491/933] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:02 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1674 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:03.148436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.148569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:03.181001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.181443 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.182228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.182713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.311296 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.318810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7c5da690-d2ba-4caf-8bef-505c927288f7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.174368 Aug 27 03:35:03.319670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 492/934] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:03 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:03.329752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.330434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:03.336393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.336829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.337582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:03.338001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:03.504014 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.513305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-60f2ef3b-784b-49d1-a669-50a40522395e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.192774 Aug 27 03:35:03.513902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 493/935] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:03 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.150742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.151570 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.158826 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.159316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.160322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.160759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.293110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.301396 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1243a373-c1a8-46fd-80a5-c9b1fae85085 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1674 microversion: 2.1 time: 0.154453 Aug 27 03:35:04.302273 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 494/936] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:04 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.338754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.339936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.346781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.347210 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.348000 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.348416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.483853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.494571 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d35f725a-9332-4c41-a42a-e70b85a9d42e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.161261 Aug 27 03:35:04.495286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 495/937] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:04 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.530502 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.531095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:04.537064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.537496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.538257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:04.538651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.664114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.672317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7c09f539-9c94-493a-bcf4-401342ed1245 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.145681 Aug 27 03:35:04.672925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 496/938] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:04 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.952911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c893e51e-3db3-49e7-9597-02f5d4efa824 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 30202 microversion: 2.20 time: 10.359233 Aug 27 03:35:04.953562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 443/939] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:34:54 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 30202 bytes in 10361 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:05.319757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.320413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.327045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.327534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.328302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.328722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.513028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.513314 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.525794 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.526212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.527038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.527496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.680212 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.688032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-00ea7570-8578-44b0-8fa1-75ed76deb78b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1674 microversion: 2.1 time: 0.371969 Aug 27 03:35:05.697569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 497/940] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:05 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1674 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.697569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.697569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.704499 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.705759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.706985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.707480 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.890706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.898637 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f76f15f4-e8dc-4736-9841-5ffac5ab9e00 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.390222 Aug 27 03:35:05.899509 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 444/941] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:05 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.966051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:05.967017 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:05.973667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.974267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:05.975052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:05.975532 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.035156 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.043211 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-55bc4f86-a6f9-4535-bfa9-68cdf8e03073 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.353580 Aug 27 03:35:06.044068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 498/942] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:05 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.062946 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8d194077-b5ea-4059-b5c1-8e7f1be11b63 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 31363 microversion: 2.20 time: 0.101254 Aug 27 03:35:06.063894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 445/943] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:05 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 31363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:06.394174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-1017fece-32f0-4dc7-a335-033b4fc826c1 req-8ee07274-c39c-4d4b-b038-69afd82afd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:06.396605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:06.396605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:06.406854 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1017fece-32f0-4dc7-a335-033b4fc826c1 req-8ee07274-c39c-4d4b-b038-69afd82afd07 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.408426 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1017fece-32f0-4dc7-a335-033b4fc826c1 req-8ee07274-c39c-4d4b-b038-69afd82afd07 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.423064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-1017fece-32f0-4dc7-a335-033b4fc826c1 req-8ee07274-c39c-4d4b-b038-69afd82afd07 service nova] Creating event network-changed:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:35:06.428749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-1017fece-32f0-4dc7-a335-033b4fc826c1 req-8ee07274-c39c-4d4b-b038-69afd82afd07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188294 Aug 27 03:35:06.429746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 499/944] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:06.706184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.707383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:06.716380 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.717166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.718206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.718712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.916833 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.917991 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:06.924806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.925376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:06.926437 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:06.927457 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.118797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.127993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e8c0795e-54c9-47e4-adf6-e1d2441d7976 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1674 microversion: 2.1 time: 0.425719 Aug 27 03:35:07.128559 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 446/945] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:06 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1674 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:07.133594 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.134377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:07.141749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.142517 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.143512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.144111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.353253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.361430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2033771f-43a2-4948-b5b9-1031d5f480ca tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.448746 Aug 27 03:35:07.362289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 500/946] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:06 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:07.367534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:07.368919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:07.379468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.380352 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.381295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:07.382441 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:07.466003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b475ea8a-6500-4e91-879b-c87105329027 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 32822 microversion: 2.20 time: 0.102278 Aug 27 03:35:07.469958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 501/947] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:07 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 32822 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:07.503093 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.511113 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-268420e6-c64c-4ae3-9a11-da9a208f7454 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.381312 Aug 27 03:35:07.511724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 447/948] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:07 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.148328 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.148844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.157160 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.157686 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.158427 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.158848 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.289038 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.300422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0f60a165-af50-4939-a821-026190588929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 200 len: 1606 microversion: 2.1 time: 0.158700 Aug 27 03:35:08.301649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 502/949] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 1606 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.399023 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.399890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.423728 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.424744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.425950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.426660 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.444034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-1852522d-47df-41fe-a092-612afb486e4e req-d4df1127-0ed0-4cc2-b119-e2d1a7dd2ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b798f8be-ccdf-4eec-b4dc-9216b13eba31", "name": "network-vif-deleted", "tag": "00f4f309-41f4-4e94-86a4-ef0178135a23"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:08.450155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:08.450155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:08.474331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1852522d-47df-41fe-a092-612afb486e4e req-d4df1127-0ed0-4cc2-b119-e2d1a7dd2ba5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.475716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1852522d-47df-41fe-a092-612afb486e4e req-d4df1127-0ed0-4cc2-b119-e2d1a7dd2ba5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.498326 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-1852522d-47df-41fe-a092-612afb486e4e req-d4df1127-0ed0-4cc2-b119-e2d1a7dd2ba5 service nova] Creating event network-vif-deleted:00f4f309-41f4-4e94-86a4-ef0178135a23 for instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 on hv-cinder-80473 Aug 27 03:35:08.512221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-1852522d-47df-41fe-a092-612afb486e4e req-d4df1127-0ed0-4cc2-b119-e2d1a7dd2ba5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069389 Aug 27 03:35:08.514749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 503/950] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:08.526082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:08.529837 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.550621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.551396 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.552585 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.555661 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.641866 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bcc0ccb1-2b05-43d0-b41b-6454c86d49d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 33509 microversion: 2.20 time: 0.124094 Aug 27 03:35:08.643415 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 504/951] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:08 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 33509 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:08.649473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.650497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.659695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.660767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.661706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.662143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.662660 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.672157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8223bd0e-c613-4b65-ae47-bf45d4f3cbf3 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.288784 Aug 27 03:35:08.672964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 448/952] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.807765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.816439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-df8b09c4-a865-4f27-a9f0-8b2cdf1d137b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1569 microversion: 2.1 time: 0.171542 Aug 27 03:35:08.817004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 505/953] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.832540 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:08.833118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.840419 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.840419 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.840914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.841342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.929835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ab2ea17e-753d-4137-8c57-33b7fb196bee tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "POST /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc/action" status: 202 len: 0 microversion: 2.1 time: 0.100740 Aug 27 03:35:08.931018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 449/954] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:08 2021] POST /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:08.941793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.942192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:08.951129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.952655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:08.953723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:08.954525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.146541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.154950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9987c329-03ee-4a7b-af73-1e422bf40691 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1577 microversion: 2.1 time: 0.218949 Aug 27 03:35:09.156180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 506/955] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:08 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:09.319699 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.320334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.329324 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.329776 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.331682 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.332201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.372790 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. Aug 27 03:35:09.374496 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:09.379039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e607b102-735c-4d6e-8048-c831a6ed35a4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 404 len: 111 microversion: 2.1 time: 0.064817 Aug 27 03:35:09.379978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 450/956] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:09 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:09.394203 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1c8ecc98-1211-4355-918c-21b52c4cdef4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '.version_select at 0x7f6cfc2561f0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.421373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1c8ecc98-1211-4355-918c-21b52c4cdef4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345526371" status: 202 len: 0 microversion: 2.1 time: 0.035639 Aug 27 03:35:09.421955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 507/957] 10.222.0.58 () {58 vars in 1221 bytes} [Fri Aug 27 03:35:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345526371 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:09.655815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:09.657945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.691593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.692961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:09.702021 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.703908 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.704911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.708573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.711316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.713115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.722701 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:09.723447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:09.820402 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-afdbf7f3-2665-4a7f-928c-6289153d4004 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 34453 microversion: 2.20 time: 0.169341 Aug 27 03:35:09.821118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 451/958] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:09 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 34453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:10.012788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:10.037136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-49a04cb9-80ab-46f1-9329-2df6a7795181 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.350696 Aug 27 03:35:10.047092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 508/959] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:09 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:10.175253 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:10.176378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:10.185395 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.186309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.187902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.188528 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.406080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:10.413047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: .version_select at 0x7f6cfc43ddc0>, body: {"keypair": {"name": "tempest-keypair-1821334418"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:10.416599 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-343ef80e-2187-4391-a3b1-6243523ea421 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1519 microversion: 2.1 time: 0.247005 Aug 27 03:35:10.417203 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 452/960] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:10 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:10.436800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:35:10.440673 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:35:10.656584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:35:10.660343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:35:10.675928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c38d1ba8-e000-42a5-8719-d20c73b71921 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.268767 Aug 27 03:35:10.682345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 509/961] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Aug 27 03:35:10 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:10.832607 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:10.833592 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:10.845269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.845900 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.846698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:10.850856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:10.961878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-75c60d3c-79a9-4fad-b299-5acfd494d448 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 35410 microversion: 2.20 time: 0.133204 Aug 27 03:35:10.962905 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 453/962] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:10 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 35410 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:11.054964 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:11.055791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:11.063379 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.063827 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.064618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.065161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.302639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.310713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a136e9c3-5ff9-4031-b797-f29b9465a77a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.260071 Aug 27 03:35:11.311623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 510/963] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:11 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:11.434676 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:11.435381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:11.442249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.442697 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.443497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.443932 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.578349 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.589219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dc5c851d-b2e8-4a23-b339-b74ee0cd5212 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.158751 Aug 27 03:35:11.601184 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-c50830da-b5ee-44f2-a0e0-e2119acbe112 req-821a2884-c4a5-4ec8-9679-a3830acaa102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "name": "network-vif-plugged", "status": "completed", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:11.603105 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:11.603105 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:11.604646 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 454/964] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:11 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:11.611201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-c50830da-b5ee-44f2-a0e0-e2119acbe112 req-821a2884-c4a5-4ec8-9679-a3830acaa102 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.611914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-c50830da-b5ee-44f2-a0e0-e2119acbe112 req-821a2884-c4a5-4ec8-9679-a3830acaa102 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.625115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-c50830da-b5ee-44f2-a0e0-e2119acbe112 req-821a2884-c4a5-4ec8-9679-a3830acaa102 service nova] Creating event network-vif-plugged:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:35:11.630120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-c50830da-b5ee-44f2-a0e0-e2119acbe112 req-821a2884-c4a5-4ec8-9679-a3830acaa102 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Aug 27 03:35:11.630703 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 511/965] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:11.975095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:11.976039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:11.982809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.983214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:11.984149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:11.984609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.092357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-026cd282-4bf1-4ee6-9620-58d79e2f91b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 36743 microversion: 2.20 time: 0.121784 Aug 27 03:35:12.093251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 455/966] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:11 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 36743 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:12.112139 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-880363249", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2334ee-c3c9-468a-845a-218e819133a7"}], "security_groups": [{"name": "tempest-securitygroup--864942390"}], "key_name": "tempest-keypair-1821334418", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:12.208269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] validate_networks() for [('ff2334ee-c3c9-468a-845a-218e819133a7', None, None, None, None, None)] {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:35:12.333459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.334264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:12.342054 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.342341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.343177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.343665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.498362 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:12.506645 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-84056544-cdd7-43d8-b194-0516a029052e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1358 microversion: 2.1 time: 0.178042 Aug 27 03:35:12.507383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 456/967] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:12 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:12.607341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.608003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:12.614667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.615728 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.616762 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.617386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.818625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:12.819069 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:12.827007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:12.827549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:12.827992 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:12.829199 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:12.837355 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-821b2cd1-6f6c-456f-83e9-e473e7d2983b tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.234475 Aug 27 03:35:12.837925 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 457/968] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:12 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:12.838771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.839554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.840535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:12.840950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:12.858977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:35:12.863241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Getting quotas for user 5c8979c080c54e9096de897a22ba40b3 and project 527dc9638ff74cfda148b7cf1b61c6c8. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:35:12.876202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:35:12.878713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:35:12.933102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ae4b54a3-96b5-4be9-b9c8-8536266f31bf tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.825802 Aug 27 03:35:12.933742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 512/969] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:35:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:12.944379 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8535ce74-f1e9-41a0-b168-f4aec5e3545d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.944987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8535ce74-f1e9-41a0-b168-f4aec5e3545d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.002316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8535ce74-f1e9-41a0-b168-f4aec5e3545d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.009995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8535ce74-f1e9-41a0-b168-f4aec5e3545d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1237 microversion: 2.1 time: 0.069602 Aug 27 03:35:13.010689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 458/970] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:12 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:13.104655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:13.105996 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.114095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.114722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.115583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.116005 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.199556 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e6339185-3c3c-42bd-9ceb-0e615369e8dd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 37741 microversion: 2.20 time: 0.098119 Aug 27 03:35:13.200098 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 513/971] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:13 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 37741 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:13.524393 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.525149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.532651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.533100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.533866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.534296 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.669609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.677389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-db94bc09-1015-4137-89d7-1f9880ad5411 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1548 microversion: 2.1 time: 0.157146 Aug 27 03:35:13.677947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 459/972] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:13 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:13.695491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.696390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.702879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.703326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.704127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.704557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.785654 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-b0da9a53-429d-4fee-97df-15204694e3b5 req-cd08dc2e-0f47-4641-987f-6cb8d37bff38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "name": "network-vif-unplugged", "status": "completed", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:13.787149 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:13.787149 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:13.794725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b0da9a53-429d-4fee-97df-15204694e3b5 req-cd08dc2e-0f47-4641-987f-6cb8d37bff38 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.795163 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b0da9a53-429d-4fee-97df-15204694e3b5 req-cd08dc2e-0f47-4641-987f-6cb8d37bff38 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.806907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-b0da9a53-429d-4fee-97df-15204694e3b5 req-cd08dc2e-0f47-4641-987f-6cb8d37bff38 service nova] Creating event network-vif-unplugged:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:35:13.812001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-b0da9a53-429d-4fee-97df-15204694e3b5 req-cd08dc2e-0f47-4641-987f-6cb8d37bff38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155403 Aug 27 03:35:13.812795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 514/973] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:13.834585 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.842386 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-53fd14b0-d2f8-4b18-83f3-37335c0aaaff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1548 microversion: 2.1 time: 0.151428 Aug 27 03:35:13.842976 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 460/974] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:13 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:13.855171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.856287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:13.857857 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.861334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:13.861334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:35:13.862353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.863263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Searching by: {'deleted': False, 'project_id': 'c24d36ba6b374775b93c113837910ba6'} {{(pid=108335) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 27 03:35:13.863808 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.864265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.865114 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.865546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.870207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.870837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.871964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:13.872394 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:13.994372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.multi_cell_list [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108335) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 27 03:35:14.094541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.104820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f6c181e4-ad1d-4a48-b5be-bdc4f0979c18 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.252247 Aug 27 03:35:14.105506 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 515/975] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:13 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:14.114307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:14.117872 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:14.124377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b5a0d8c9-4cff-4168-b9fd-23b2d57c7ed0 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.269786 Aug 27 03:35:14.131065 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 461/976] 10.222.0.58 () {58 vars in 1125 bytes} [Fri Aug 27 03:35:13 2021] GET /compute/v2.1/servers => generated 343 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:14.133975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.134591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.135588 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.136181 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.138387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:14.139649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:14.147280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.147943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.149092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.149702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.261928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.273780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b15b3aa9-cadd-4aef-9499-056bef5f6920 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1295 microversion: 2.1 time: 0.165547 Aug 27 03:35:14.274588 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 516/977] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:14 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:14.289740 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:14.290924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:14.297462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.298164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.299125 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:14.299761 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:14.370785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.379989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0a284fd5-a639-4657-9ed1-3da04333b690 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1548 microversion: 2.1 time: 0.248379 Aug 27 03:35:14.380673 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 462/978] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:14 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:14.398406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-794ad152-d195-4895-947c-43a0692ecce2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 38239 microversion: 2.20 time: 0.110957 Aug 27 03:35:14.399842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 517/979] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:14 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 38239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:15.122631 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.123276 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.129569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.130181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.130764 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.131195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.291314 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.292563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.300099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.300516 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.301566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.302496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.413873 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.422280 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-166f6bb0-47bd-4e6f-ae42-5e1e06c28d52 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.303581 Aug 27 03:35:15.432269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 463/980] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:15 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.432269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:15.432269 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.435694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.436160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.436938 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.437363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.501639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fac0f0c5-42c5-4165-8bc2-dd57d0a56101 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 38239 microversion: 2.20 time: 0.077084 Aug 27 03:35:15.502288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 464/981] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:15 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 38239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:15.544709 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.553094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9053f9dd-28ef-41f6-b90b-139afdfaafd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.265490 Aug 27 03:35:15.553780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 518/982] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:15 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.948667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-b071f5a6-3005-424e-a2ea-4232dd38509b req-966c5422-2dda-497d-aa4c-83bd9904e8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e8fdbe-3d56-4b42-967b-5d8bbf0e281e", "tag": "5dd572f1-816d-41f0-bfc3-8a5318f6cc06"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:15.950983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:15.950983 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:35:15.960484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b071f5a6-3005-424e-a2ea-4232dd38509b req-966c5422-2dda-497d-aa4c-83bd9904e8ef service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.961114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b071f5a6-3005-424e-a2ea-4232dd38509b req-966c5422-2dda-497d-aa4c-83bd9904e8ef service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.973145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fd4665c-291a-4f74-baf9-d98aebfccefb"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:15.973970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-b071f5a6-3005-424e-a2ea-4232dd38509b req-966c5422-2dda-497d-aa4c-83bd9904e8ef service nova] Creating event network-changed:5dd572f1-816d-41f0-bfc3-8a5318f6cc06 for instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e on hv-cinder-80473 Aug 27 03:35:15.976361 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:15.979503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-b071f5a6-3005-424e-a2ea-4232dd38509b req-966c5422-2dda-497d-aa4c-83bd9904e8ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 Aug 27 03:35:15.980439 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 465/983] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:15.985954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.986559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:15.987554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:15.988218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.243693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-00eab027-e605-42be-a6a7-b8b16ae5461a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274800 Aug 27 03:35:16.244537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 519/984] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:35:15 2021] POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:16.441039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.441792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:16.448485 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.448973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.449930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.450320 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.516192 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:16.517555 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:16.525018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.525443 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.526333 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.526827 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.592708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1ad62961-b2c5-42f1-8fb2-29dc480ac51a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 38239 microversion: 2.20 time: 0.081794 Aug 27 03:35:16.597554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 520/985] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:16 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 38239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:16.598802 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.599633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:16.606818 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.607373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.608278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:16.608722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:16.718538 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:16.729594 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2b593ab5-8244-4d3a-b254-81b487af3cb9 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.293020 Aug 27 03:35:16.730461 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 466/986] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:16 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:16.834409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:16.843117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8cc2bc24-6bfd-45af-b533-22e17341fd3b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.248253 Aug 27 03:35:16.843844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 521/987] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:16 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:17.607162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:17.608121 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:17.614806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.615263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.616104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.616563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.704067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ef040b7f-3afc-4a70-8b71-4c8f90ec1a20 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 200 len: 38380 microversion: 2.20 time: 0.102134 Aug 27 03:35:17.704733 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 467/988] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:17 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 38380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:17.714718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.715255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:17.721836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.722270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.723228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.723728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.747521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3e54a28d-3e4b-4038-89b3-1fb760268f93 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/ips" status: 200 len: 151 microversion: 2.20 time: 0.036466 Aug 27 03:35:17.748365 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.748542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 522/989] 10.222.0.58 () {60 vars in 1289 bytes} [Fri Aug 27 03:35:17 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:35:17.749449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:17.756747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.757223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.757996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.758423 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.860670 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.861348 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:17.868104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.868535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.869323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:17.869733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:17.986961 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:17.996526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9fbd4bba-b741-4800-97bd-ed62f6c29491 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1575 microversion: 2.1 time: 0.252076 Aug 27 03:35:17.997597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 468/990] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:17 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:18.094884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:18.104689 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-dac028cf-57c7-4156-bddd-701c7091ecd1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.248020 Aug 27 03:35:18.105317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 523/991] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:17 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:19.014086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:19.014745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:19.021012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.021448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.022200 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.022616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.123045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:19.123721 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:19.130110 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.130559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.131543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.132436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.162019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:19.169939 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b1dbfd73-04dc-493a-a6fe-9fe058554895 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1562 microversion: 2.1 time: 0.159925 Aug 27 03:35:19.170522 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 469/992] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:19 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:19.265469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:19.273052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ef74da92-2f1d-4016-b6cc-1a5303a004c1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.154628 Aug 27 03:35:19.273627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 524/993] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:19 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:19.816074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:19.816612 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:19.823342 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.824219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.824997 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:19.825414 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:19.848982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lazy-loading 'flavor' on Instance uuid 46d79045-6606-4046-b902-58e716cb2375 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:20.139133 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e33fa50c-0ac4-422f-b8c6-682156d478e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 202 len: 0 microversion: 2.20 time: 0.326749 Aug 27 03:35:20.140045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 470/994] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:19 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:20.148222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:20.148855 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:20.156036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.156466 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:20.157470 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.157914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:20.290217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.291767 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:20.293806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:20.301399 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.301612 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.302205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:20.303287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:20.303649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.303853 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:20.305371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d7c55612-b704-4af6-a618-4342c04dd8d1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.161076 Aug 27 03:35:20.307553 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 525/995] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:20 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:20.435777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.443533 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-31de9860-afde-445a-994e-ef6d2a7c314a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.155981 Aug 27 03:35:20.444114 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 471/996] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:20 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.156937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-77805433", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:21.217122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.network.neutron [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] validate_networks() for None {{(pid=108336) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:35:21.325854 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.326407 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:21.333345 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.333783 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.334578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.334999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.559763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Flavor limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:21.560278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Image limits 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:21.560982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Flavor pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:21.561433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Image pref 0:0:0 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:21.561920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.virt.hardware [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:21.572134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.572573 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.573361 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.573785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.574903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.585622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.587018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.589197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c056965a-bc49-4514-b6c2-a924bfea88b3 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.266797 Aug 27 03:35:21.590502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 472/997] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:21.591099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Getting quotas for project 2dc92177ed0c4f6e90ebbcdb3794bf56. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:35:21.595928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.596695 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:21.600744 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Getting quotas for user 271d042b5b5e4c7d93d2d53e345862c3 and project 2dc92177ed0c4f6e90ebbcdb3794bf56. Resources: {'instances', 'ram', 'cores'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:35:21.605914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.607952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.609309 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.609906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.622551 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Going to run 1 instances... {{(pid=108336) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:35:21.625126 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:35:21.677822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-88b79806-a1e6-4bbd-b317-b234be71cf8b tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524611 Aug 27 03:35:21.678762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 526/998] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:35:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:21.683447 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-1fb1ab1f-705a-45ae-90df-2f523715b069 req-7060052c-5917-4e4f-95a5-e6146fa1a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "name": "network-vif-plugged", "status": "completed", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:21.686014 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:21.686014 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:21.695471 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1fb1ab1f-705a-45ae-90df-2f523715b069 req-7060052c-5917-4e4f-95a5-e6146fa1a243 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:21.695940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-1fb1ab1f-705a-45ae-90df-2f523715b069 req-7060052c-5917-4e4f-95a5-e6146fa1a243 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:21.709410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-1fb1ab1f-705a-45ae-90df-2f523715b069 req-7060052c-5917-4e4f-95a5-e6146fa1a243 service nova] Creating event network-vif-plugged:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:35:21.715693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-1fb1ab1f-705a-45ae-90df-2f523715b069 req-7060052c-5917-4e4f-95a5-e6146fa1a243 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035120 Aug 27 03:35:21.715693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 527/999] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:21.720442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0f5a65c5-e7e2-4048-8f25-5ff698028332 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.721116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0f5a65c5-e7e2-4048-8f25-5ff698028332 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:21.788645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0f5a65c5-e7e2-4048-8f25-5ff698028332 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.800717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0f5a65c5-e7e2-4048-8f25-5ff698028332 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1213 microversion: 2.1 time: 0.083158 Aug 27 03:35:21.802035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 528/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.816495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.824209 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5fb2be53-27ec-403b-9479-5d8d758d8ae0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.232046 Aug 27 03:35:21.827898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 473/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:21 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:22.608381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.608981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:22.615237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.615737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.616498 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.616919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.786133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.796604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.798255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.799630 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3cb2b60c-dbb2-446e-b106-77ea70f18ae1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.195283 Aug 27 03:35:22.800754 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 529/1002] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:22 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:22.817839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.818444 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:22.824904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.825401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.826811 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.827243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.845444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.846589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:22.857472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.858532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.859265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:22.859750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:22.920308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.928055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fa5ee538-8321-4f9d-abc3-43b98ccaae18 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1283 microversion: 2.1 time: 0.113883 Aug 27 03:35:22.928804 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 474/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:22 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:23.098865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.106469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-86b79a99-605b-4ec8-ae87-462008272643 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.268974 Aug 27 03:35:23.107111 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 530/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:22 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:23.750267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-2dc17946-a919-420e-a948-39fbe1f4dd4a req-9d40b78e-cd45-45a4-b60c-f4cc262767ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e8fdbe-3d56-4b42-967b-5d8bbf0e281e", "name": "network-vif-plugged", "status": "completed", "tag": "5dd572f1-816d-41f0-bfc3-8a5318f6cc06"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:23.752311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:23.752311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:35:23.761187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2dc17946-a919-420e-a948-39fbe1f4dd4a req-9d40b78e-cd45-45a4-b60c-f4cc262767ef service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.761770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2dc17946-a919-420e-a948-39fbe1f4dd4a req-9d40b78e-cd45-45a4-b60c-f4cc262767ef service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.776627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-2dc17946-a919-420e-a948-39fbe1f4dd4a req-9d40b78e-cd45-45a4-b60c-f4cc262767ef service nova] Creating event network-vif-plugged:5dd572f1-816d-41f0-bfc3-8a5318f6cc06 for instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e on hv-cinder-80473 Aug 27 03:35:23.782381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-2dc17946-a919-420e-a948-39fbe1f4dd4a req-9d40b78e-cd45-45a4-b60c-f4cc262767ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036520 Aug 27 03:35:23.783930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 475/1005] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:23.821218 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:23.821887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:23.829263 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.829874 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.831047 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.831610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.946039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:23.946652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:23.953583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.954204 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:23.955207 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:23.956101 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.421186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.430863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.433168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.434627 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b397abdb-137f-40ab-9920-b201dea86667 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.618945 Aug 27 03:35:24.435323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 531/1006] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:23 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:24.440358 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.441185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:24.447867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.448384 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.449823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.450325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.544900 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.553437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-33fc1a60-1dd4-4e35-9af3-857be8feaa87 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.611903 Aug 27 03:35:24.554383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 476/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:23 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:24.559098 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.559731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:24.566210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.566655 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.567464 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:24.567896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:24.704724 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.712788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-160b300c-c48e-47bb-8d6e-d7498b3ad6a7 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1594 microversion: 2.1 time: 0.276380 Aug 27 03:35:24.713339 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 532/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:24 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1594 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:24.833605 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.842819 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b74097fb-9645-4a5f-ae79-55342e255e33 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.286646 Aug 27 03:35:24.843699 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 477/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:24 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:25.007970 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-680e52fa-8ac4-4c29-ac49-3eaea912e3b0 req-142da395-dc71-4370-80ee-45f88dc2b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3862c4e-bb90-4316-8c53-336cf65723cd", "tag": "cc527f93-9b68-439b-b2d5-688256dcc7c6"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:25.011592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:25.011592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:25.021411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-680e52fa-8ac4-4c29-ac49-3eaea912e3b0 req-142da395-dc71-4370-80ee-45f88dc2b0d8 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.022233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-680e52fa-8ac4-4c29-ac49-3eaea912e3b0 req-142da395-dc71-4370-80ee-45f88dc2b0d8 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.037495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-680e52fa-8ac4-4c29-ac49-3eaea912e3b0 req-142da395-dc71-4370-80ee-45f88dc2b0d8 service nova] Creating event network-changed:cc527f93-9b68-439b-b2d5-688256dcc7c6 for instance b3862c4e-bb90-4316-8c53-336cf65723cd on hv-cinder-80473 Aug 27 03:35:25.044922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-680e52fa-8ac4-4c29-ac49-3eaea912e3b0 req-142da395-dc71-4370-80ee-45f88dc2b0d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048397 Aug 27 03:35:25.046013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 533/1010] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:25.454493 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.455249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:25.464343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.465128 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.466311 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.467024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.572005 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.572933 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:25.580180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.580766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.581557 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.581983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.680892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.690252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.692863 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.694247 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-10b16936-6b47-46c9-8d45-6fe5c2b7b6e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.244923 Aug 27 03:35:25.695793 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 478/1011] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:25 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:25.858942 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.863785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.864606 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:25.868738 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6890178c-8c8b-4333-a115-f03284e62f6d tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.300611 Aug 27 03:35:25.871155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 534/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:25 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:25.875243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.875999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:25.877575 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:25.878177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.186843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.197096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-647e4209-4129-42ce-b56e-db065f76374b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1362 microversion: 2.1 time: 0.340631 Aug 27 03:35:26.198158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 479/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:25 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:26.714301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.715002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:26.721638 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.722353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.723340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.723998 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.808400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-5c18c6bd-dfeb-48cd-b3d7-aa3e432405fc req-637699a2-8a49-4ca0-9aa9-fbde1a3cb529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:26.811731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:26.811731 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:26.820031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-5c18c6bd-dfeb-48cd-b3d7-aa3e432405fc req-637699a2-8a49-4ca0-9aa9-fbde1a3cb529 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.820640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-5c18c6bd-dfeb-48cd-b3d7-aa3e432405fc req-637699a2-8a49-4ca0-9aa9-fbde1a3cb529 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.833475 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-5c18c6bd-dfeb-48cd-b3d7-aa3e432405fc req-637699a2-8a49-4ca0-9aa9-fbde1a3cb529 service nova] Creating event network-changed:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:35:26.839034 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-5c18c6bd-dfeb-48cd-b3d7-aa3e432405fc req-637699a2-8a49-4ca0-9aa9-fbde1a3cb529 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179229 Aug 27 03:35:26.839790 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 535/1014] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:26.887566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.888593 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:26.896439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.896844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.898063 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:26.898769 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:26.968997 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.981736 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.985772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.988047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-20076c47-7e7d-4308-8416-e2a9ddb3b551 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.277586 Aug 27 03:35:26.988881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 480/1015] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:26 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:27.138537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.151642 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3b11acc1-f378-4d08-9e7f-1a29ea9ffac0 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.268353 Aug 27 03:35:27.152750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 536/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:26 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:27.219103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.219103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:27.224973 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.225416 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.226325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.226797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.502639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.512562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-71a97baa-2ec8-4d06-bf63-404fd2225a7e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1548 microversion: 2.1 time: 0.301727 Aug 27 03:35:27.513577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 481/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:27 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1548 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:27.529465 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.530242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:27.537491 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.538307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.539729 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.540314 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.668136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-12962327-864d-4e84-b476-f23873f16061 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142750 Aug 27 03:35:27.681056 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 537/1018] 10.222.0.58 () {58 vars in 1275 bytes} [Fri Aug 27 03:35:27 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:27.984568 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-432645167"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:27.985173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:27.991336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.991776 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:27.992548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:27.992966 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.006283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:28.006934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:28.015515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.015952 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.016723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.017138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.337802 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.network.security_group_api [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Adding security group 26b3cc1d-dbb6-40f4-8340-a1379f3a6b1d to port 9bb5206b-382a-4dac-a93b-17b51b935b5a Aug 27 03:35:28.343789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.352501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.354135 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.355376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e810dc65-17f2-4ea1-a604-11ab3ead37bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.353140 Aug 27 03:35:28.356052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 538/1019] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:28 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:28.361042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:28.362159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:28.372274 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.373042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.373776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:28.374406 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:28.956230 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.963597 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bec31871-e472-4043-a9a8-3876d709d4fc tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.606400 Aug 27 03:35:28.964166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 539/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:28 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:29.309926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8f787436-d1e1-4a5c-b353-45065663239c tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action" status: 202 len: 0 microversion: 2.1 time: 1.329037 Aug 27 03:35:29.315989 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 482/1021] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:27 2021] POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:29.322981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.327033 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:29.330380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-ba6605fd-3ecc-42f3-ba02-936da38f154c req-4c81c423-f5f1-41e4-89de-d0761b02c046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:29.338944 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.339408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.340412 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:29.340412 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:29.345166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.345662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.354695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ba6605fd-3ecc-42f3-ba02-936da38f154c req-4c81c423-f5f1-41e4-89de-d0761b02c046 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.355141 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ba6605fd-3ecc-42f3-ba02-936da38f154c req-4c81c423-f5f1-41e4-89de-d0761b02c046 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.383847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-ba6605fd-3ecc-42f3-ba02-936da38f154c req-4c81c423-f5f1-41e4-89de-d0761b02c046 service nova] Creating event network-changed:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:35:29.395959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-ba6605fd-3ecc-42f3-ba02-936da38f154c req-4c81c423-f5f1-41e4-89de-d0761b02c046 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071312 Aug 27 03:35:29.402046 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 540/1022] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:29.412202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.415488 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:29.423878 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.424628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.425584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.426483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.758271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.767855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.768664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.770566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.772116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-bb2f9e66-c241-480c-a93d-bf8994c570e7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.367807 Aug 27 03:35:29.773342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 541/1023] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:29 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:29.778154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:29.779619 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:29.789582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.790033 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.790818 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.791249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.794680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a496ff46-11ee-41f9-9555-9093feafeeba tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1758 microversion: 2.1 time: 0.475421 Aug 27 03:35:29.795904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 483/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:29 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1758 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:29.868889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-25bab2ed-7edd-4406-ba18-cc422d8d7cca tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.093815 Aug 27 03:35:29.869569 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 542/1025] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:29 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:29.981843 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.982948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:29.989610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.990193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:29.990992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:29.991440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.208067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.216373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a20c9f4e-a1fd-4289-bf82-1bb36123e9bf tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.238767 Aug 27 03:35:30.216876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 484/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:29 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:30.483916 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-56d8eb19-28e5-4ccc-bf03-a980c53c4d6d req-4e634320-104c-4b21-a570-8b64d768429a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3862c4e-bb90-4316-8c53-336cf65723cd", "name": "network-vif-plugged", "status": "completed", "tag": "cc527f93-9b68-439b-b2d5-688256dcc7c6"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:30.485537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:30.485537 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:30.493145 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-56d8eb19-28e5-4ccc-bf03-a980c53c4d6d req-4e634320-104c-4b21-a570-8b64d768429a service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.493575 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-56d8eb19-28e5-4ccc-bf03-a980c53c4d6d req-4e634320-104c-4b21-a570-8b64d768429a service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.505657 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-56d8eb19-28e5-4ccc-bf03-a980c53c4d6d req-4e634320-104c-4b21-a570-8b64d768429a service nova] Creating event network-vif-plugged:cc527f93-9b68-439b-b2d5-688256dcc7c6 for instance b3862c4e-bb90-4316-8c53-336cf65723cd on hv-cinder-80473 Aug 27 03:35:30.511093 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-56d8eb19-28e5-4ccc-bf03-a980c53c4d6d req-4e634320-104c-4b21-a570-8b64d768429a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 Aug 27 03:35:30.511959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 543/1027] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:30.791720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.792323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:30.798318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.798761 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.799556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.800005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.881204 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:30.882235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:30.889756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.890223 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.891015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:30.891472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:30.929951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.938443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.940024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.941225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-25ab1eaf-1eb4-4428-aa62-f25f97b8d3b7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.153322 Aug 27 03:35:30.941813 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 485/1028] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:30 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:31.012950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-92b82fd6-aef7-43af-9c12-f73d19036455 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.135513 Aug 27 03:35:31.014103 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 544/1029] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:30 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:35:31.234063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.234739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:31.241818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.242271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.243059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.243527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.376815 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.384768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f04b71db-7cf0-4275-9a1e-7f3929bb59b1 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1313 microversion: 2.1 time: 0.154948 Aug 27 03:35:31.385340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 486/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:31 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:31.413867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-e581c606-9ad4-4a2e-8d0b-b98d18cdfde6 req-28c774c6-20da-4b6c-ada3-976d598e9e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e8fdbe-3d56-4b42-967b-5d8bbf0e281e", "tag": "5dd572f1-816d-41f0-bfc3-8a5318f6cc06"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:31.415407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:31.415407 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:31.423877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e581c606-9ad4-4a2e-8d0b-b98d18cdfde6 req-28c774c6-20da-4b6c-ada3-976d598e9e1f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.424313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e581c606-9ad4-4a2e-8d0b-b98d18cdfde6 req-28c774c6-20da-4b6c-ada3-976d598e9e1f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.436792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-e581c606-9ad4-4a2e-8d0b-b98d18cdfde6 req-28c774c6-20da-4b6c-ada3-976d598e9e1f service nova] Creating event network-changed:5dd572f1-816d-41f0-bfc3-8a5318f6cc06 for instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e on hv-cinder-80473 Aug 27 03:35:31.441728 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-e581c606-9ad4-4a2e-8d0b-b98d18cdfde6 req-28c774c6-20da-4b6c-ada3-976d598e9e1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Aug 27 03:35:31.442313 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 545/1031] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:31.961916 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.962508 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:31.970175 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.970999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:31.971829 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:31.972225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.024767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:32.025766 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:32.032123 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.032554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.033315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.033746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.101772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.110527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.112160 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.113351 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b5d0dce7-423f-4965-aecc-3fd1c1768294 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.155444 Aug 27 03:35:32.113917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 487/1032] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:31 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:32.133283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-66aa81d9-9ad4-416e-b324-08276aa29ae2 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.112544 Aug 27 03:35:32.134520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 546/1033] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:32 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:35:32.402483 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.403171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:32.410062 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.410510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.411284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.411749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.542527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.550471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4c1c1ee9-565f-4ddb-9632-18c100f8294e tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1463 microversion: 2.1 time: 0.152406 Aug 27 03:35:32.551027 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 488/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:32 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:32.588422 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.589002 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:32.596032 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.596476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.597242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.597675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.622678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:35:32.708782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7d55b3aa-e4b5-4ff6-9d29-b6cde7437417 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 204 len: 0 microversion: 2.1 time: 0.123765 Aug 27 03:35:32.709385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 547/1035] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:35:32 2021] DELETE /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:32.718674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.719412 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:32.725965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.727074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.727908 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:32.728602 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:32.882685 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.891480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-feca6cd8-a72b-408b-a0bc-eaef8e8405af tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1469 microversion: 2.1 time: 0.177135 Aug 27 03:35:32.892100 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 489/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:32 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:33.139836 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.141277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:33.145126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:33.146163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:33.148297 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.148762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.149602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.150071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.152591 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.153056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.153885 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.154312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.225619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8df7aacf-1948-4753-9b5f-556f9f7e828a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.084241 Aug 27 03:35:33.226270 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 490/1037] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:33 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:33.301150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.313928 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.315779 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.317247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-95ce583b-ed88-4b3f-b664-3c6245aa74ca tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.181988 Aug 27 03:35:33.317948 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 548/1038] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:33 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:33.913702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.914707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:33.925906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.926963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:33.928273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:33.929018 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.079523 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.092288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-467e3368-445b-4d0a-b9ce-e48557bbce07 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1469 microversion: 2.1 time: 0.185800 Aug 27 03:35:34.092878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 491/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:33 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1469 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:34.237914 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:34.238810 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:34.245860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.246298 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.247196 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.248031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.327338 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2135833f-2c6f-4a73-aae2-61fbcc5bfe76 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.092696 Aug 27 03:35:34.328101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 549/1040] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:34 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:35:34.338434 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:34.339013 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:34.345495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.345966 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.346763 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.347177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:34.498870 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.507334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.508909 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.510353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f5893881-6020-4ef8-a50d-e28f42371dc4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.175683 Aug 27 03:35:34.510910 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 492/1041] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:34 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:34.975193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-e6db0b39-0d69-4201-845f-f60ac43d3cd8 req-0b263366-f389-44eb-8677-5b4ea4d18249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3862c4e-bb90-4316-8c53-336cf65723cd", "name": "network-vif-deleted", "tag": "cc527f93-9b68-439b-b2d5-688256dcc7c6"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:34.977418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:34.977418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:34.986751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e6db0b39-0d69-4201-845f-f60ac43d3cd8 req-0b263366-f389-44eb-8677-5b4ea4d18249 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:34.987276 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e6db0b39-0d69-4201-845f-f60ac43d3cd8 req-0b263366-f389-44eb-8677-5b4ea4d18249 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.001417 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-e6db0b39-0d69-4201-845f-f60ac43d3cd8 req-0b263366-f389-44eb-8677-5b4ea4d18249 service nova] Creating event network-vif-deleted:cc527f93-9b68-439b-b2d5-688256dcc7c6 for instance b3862c4e-bb90-4316-8c53-336cf65723cd on hv-cinder-80473 Aug 27 03:35:35.006816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-e6db0b39-0d69-4201-845f-f60ac43d3cd8 req-0b263366-f389-44eb-8677-5b4ea4d18249 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035971 Aug 27 03:35:35.008069 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 550/1042] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:35.115839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.116827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:35.126371 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.127164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.128529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.129292 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.176179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.177104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.177835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lazy-loading 'fault' on Instance uuid b3862c4e-bb90-4316-8c53-336cf65723cd {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:35:35.229294 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271d042b5b5e4c7d93d2d53e345862c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.237952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cab51cdb-68d7-45b6-9cff-e2beec43cf06 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 200 len: 1303 microversion: 2.1 time: 0.129832 Aug 27 03:35:35.238578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 493/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:35 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:35.342119 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:35.343439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:35.349961 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.350391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.351140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.351594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.418030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-edc4f16c-7ff0-4b68-903c-39b5d6b07ca1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.081048 Aug 27 03:35:35.418685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 551/1044] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:35 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:35.529589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.530292 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:35.537251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.537693 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.538474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:35.538902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:35.683882 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.701742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.704256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.705500 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ce48bfb9-0d21-4f28-8705-39e600d8e4f0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.180398 Aug 27 03:35:35.706155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 494/1045] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:35 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:36.261138 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.262249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] [instance: b3862c4e-bb90-4316-8c53-336cf65723cd] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:36.273783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.274510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.275835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.276536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.292695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] HTTP exception thrown: Instance b3862c4e-bb90-4316-8c53-336cf65723cd could not be found. Aug 27 03:35:36.293285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] Returning 404 to user: Instance b3862c4e-bb90-4316-8c53-336cf65723cd could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:35:36.294099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5e5285f4-bc10-4260-8366-0ab149cbf355 tempest-VolumesNegativeTest-654983854 tempest-VolumesNegativeTest-654983854-project] 10.222.0.58 "GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd" status: 404 len: 111 microversion: 2.1 time: 0.040008 Aug 27 03:35:36.294962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 552/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:35:36 2021] GET /compute/v2.1/servers/b3862c4e-bb90-4316-8c53-336cf65723cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:36.429848 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:36.430904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:36.437230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.437752 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.438838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.439004 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.509366 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d7eed63c-04fe-48c3-8c64-6ddb15a98908 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.083543 Aug 27 03:35:36.510006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 495/1047] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:36 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:36.725772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.726389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:36.732695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.733148 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.733922 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:36.734364 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:36.859316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.867934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.869405 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.870545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-326711a9-df6d-4dd0-b3df-8fa2685d0ba9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1742 microversion: 2.20 time: 0.149655 Aug 27 03:35:36.871091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 553/1048] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:36 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:37.521953 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:37.523111 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:37.529472 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.530222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:37.530995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.531448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:37.594719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ad16b334-dc86-455b-bb3d-575d34dc4c52 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.077612 Aug 27 03:35:37.598491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 496/1049] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:37 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:37.891725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.892707 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:37.901693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.902215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:37.903623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:37.904150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:38.068796 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.078805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.080911 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.083016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-13258b9e-1a3b-4c7c-b87a-6460fc2616bb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.197906 Aug 27 03:35:38.095659 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 554/1050] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:37 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:38.612806 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:38.618832 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:38.625822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:38.626578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:38.627635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:38.628365 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:38.712305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-126df622-123d-4e3d-809a-4516f3234340 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.108041 Aug 27 03:35:38.712953 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 497/1051] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:38 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:39.105235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:39.105980 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:39.112070 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:39.112806 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.113865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:39.114514 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.250695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.259696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.262778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.264183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6a9796cb-f7ab-4a84-b65f-de6487ca901e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.162921 Aug 27 03:35:39.264944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 555/1052] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:39 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:39.723624 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:39.725820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:39.734397 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:39.735209 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.736192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:39.736707 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.808403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-81760801-1b5c-42a2-b897-b45fc1c1de06 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.088770 Aug 27 03:35:39.809291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 498/1053] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:39 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:39.823520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-15fca246-1b08-48e5-aa6f-99dbe87f1229 req-0c7ed171-7b17-4d3d-985e-cc8f5c7cfa01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "name": "network-vif-plugged", "status": "completed", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:39.828559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:39.828559 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:39.841946 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-15fca246-1b08-48e5-aa6f-99dbe87f1229 req-0c7ed171-7b17-4d3d-985e-cc8f5c7cfa01 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:39.842380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-15fca246-1b08-48e5-aa6f-99dbe87f1229 req-0c7ed171-7b17-4d3d-985e-cc8f5c7cfa01 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:39.861237 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-15fca246-1b08-48e5-aa6f-99dbe87f1229 req-0c7ed171-7b17-4d3d-985e-cc8f5c7cfa01 service nova] Creating event network-vif-plugged:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:35:39.867646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-15fca246-1b08-48e5-aa6f-99dbe87f1229 req-0c7ed171-7b17-4d3d-985e-cc8f5c7cfa01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052534 Aug 27 03:35:39.868773 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 556/1054] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:40.283255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:40.284438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:40.292520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.293255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.294028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.294623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.460639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.468855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.470739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.474885 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c1eea9b9-46c5-45d5-b7b0-53974eaac554 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.193635 Aug 27 03:35:40.475974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 499/1055] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:40 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:40.822517 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:40.823870 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:40.830363 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.831245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.832035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:40.832434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:40.924657 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-876e4bbc-072b-4aba-9f94-3c61bd18dd73 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 14 microversion: 2.1 time: 0.107678 Aug 27 03:35:40.927920 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 557/1056] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:40 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:35:41.494023 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.494637 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:41.501469 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.502183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:41.503222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.503825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:41.641366 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.650640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.652163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.653625 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-520905d3-3d58-4dd8-80f5-11d89553ad29 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.163783 Aug 27 03:35:41.654888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 500/1057] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:41 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:41.937315 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:41.938395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:41.945105 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.945863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:41.946722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:41.947183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:42.027679 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-17966756-23e3-438a-ba38-cc9f0734dbbc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 4298 microversion: 2.1 time: 0.094412 Aug 27 03:35:42.031069 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 558/1058] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:41 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 4298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.676158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.678958 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:42.686948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:42.687405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:42.688191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:42.688629 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:42.832432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.841650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.843488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.845454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2d394ae2-ff8a-4f61-b63b-ee4778caa12b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.176012 Aug 27 03:35:42.846384 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 501/1059] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:42 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:43.039841 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:43.040910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:43.053771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.055850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:43.057939 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.058951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:43.156284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-82df6259-497c-42e5-86d5-979d2550ca62 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 10893 microversion: 2.1 time: 0.121027 Aug 27 03:35:43.157320 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 559/1060] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:43 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 10893 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:43.864802 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.865943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:43.871790 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.872230 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:43.873258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:43.873687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:44.014047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.022685 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.024206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.025381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-985aa2c2-6cbd-41bb-bc42-c4f42ba179ee tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.164785 Aug 27 03:35:44.025945 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 502/1061] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:43 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:44.169508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:44.170651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:44.178068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:44.178501 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:44.179632 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:44.180167 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:44.258926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b5f1be62-5cea-4ce6-89d2-06ad0f79e474 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 15680 microversion: 2.1 time: 0.093796 Aug 27 03:35:44.262958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 560/1062] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:44 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 15680 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:35:45.046155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:45.046803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:45.055529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:45.056243 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:45.057222 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:45.057640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:45.209668 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:45.218381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:45.220562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:45.222009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cac29328-ee63-43fc-9f0b-fa2497d648c6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.179730 Aug 27 03:35:45.222871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 503/1063] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:45 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:45.271242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:45.272937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:45.280376 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:45.281133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:45.282077 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:45.282498 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:45.370455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1a069a9c-fa69-4b2c-95d7-b08e1113f380 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 17931 microversion: 2.1 time: 0.103089 Aug 27 03:35:45.371485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 561/1064] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:45 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 17931 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:46.240546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.241379 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:46.248003 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:46.248731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:46.249742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:46.250165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:46.390264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:46.392221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:46.396760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.400863 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:46.401331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:46.402117 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:46.402550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:46.405704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.407391 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.408421 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c6ed9e18-80a8-4c69-a25c-1f2bc7bdd44e tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.171803 Aug 27 03:35:46.409362 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 504/1065] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:46 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:46.486264 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b276be34-9e25-4665-8159-c3d27ac9db17 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 19342 microversion: 2.1 time: 0.103288 Aug 27 03:35:46.487095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 562/1066] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:46 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:35:47.428301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:47.428993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:47.435745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.436193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.436977 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.437455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.501149 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:47.502154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:47.509572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.510040 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.510795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:47.511214 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:47.566086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.574233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.575770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.576920 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e3dae683-49b8-4210-b796-268a2f1cbf1d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1737 microversion: 2.20 time: 0.153453 Aug 27 03:35:47.577494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 505/1067] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:47 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:47.635564 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-727af780-eb80-4768-8ac1-82b9ae8f3b85 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 20757 microversion: 2.1 time: 0.138067 Aug 27 03:35:47.636599 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 563/1068] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:47 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 20757 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:35:48.596589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.597565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:48.605088 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.605582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.606465 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.606957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.650295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:48.651213 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:48.658174 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.658691 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.659560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:48.660072 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:48.734398 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.741269 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d7d349e4-ce7f-4b2c-87de-1360e7bf61af tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 22482 microversion: 2.1 time: 0.095045 Aug 27 03:35:48.745197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 564/1069] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:48 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 22482 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:48.745357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.745357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.745688 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9b2c99ce-753d-4da6-aced-6a438a16f6f9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1719 microversion: 2.20 time: 0.153574 Aug 27 03:35:48.746233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 506/1070] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:48 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:49.753084 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:49.754115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:49.761177 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.761614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:49.762382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.762800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:49.763642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:49.764257 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:49.770646 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.771089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:49.771876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:49.772307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:49.845030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-67523f48-685a-4f6c-9778-bd4714c13e69 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 23222 microversion: 2.1 time: 0.095909 Aug 27 03:35:49.849201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 565/1071] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:49 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 23222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:49.903807 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.913135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.914619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.915788 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-319e3a3b-35bd-4d0e-b509-7153a14949b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1719 microversion: 2.20 time: 0.156114 Aug 27 03:35:49.916347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 507/1072] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:49 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:50.859154 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:50.860344 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:50.868685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:50.869241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:50.870086 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:50.870610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:50.935340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.935996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:50.944502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:50.945034 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:50.945954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:50.946644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:50.960710 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a1f75380-f1fb-4e53-99aa-e13057004249 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 24416 microversion: 2.1 time: 0.106303 Aug 27 03:35:50.961341 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 566/1073] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:50 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 24416 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:51.086729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:51.098949 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:51.101173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:51.102803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-49aeecb6-6b83-4f76-ae1e-94a2058d1df6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1662 microversion: 2.20 time: 0.171964 Aug 27 03:35:51.103573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 508/1074] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:50 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1662 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:51.124913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cdf1939-2ca1-4748-abbd-df54d957e77a"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:51.126029 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:51.133061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.133507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.134285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.134748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.427915 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-492d1f38-598e-462c-87a3-343d26049c7a tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307344 Aug 27 03:35:51.428520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 567/1075] 10.222.0.58 () {62 vars in 1364 bytes} [Fri Aug 27 03:35:51 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:51.555940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:51.556436 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:51.562903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.563376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.564137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.564567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.826526 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-b99804d3-a6d1-43fc-887d-69476cce343b req-5751f98c-320b-4f1e-a97f-2a2688fe6e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "name": "network-vif-unplugged", "status": "completed", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:51.828341 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:35:51.828341 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:35:51.836171 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b99804d3-a6d1-43fc-887d-69476cce343b req-5751f98c-320b-4f1e-a97f-2a2688fe6e73 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.836860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-b99804d3-a6d1-43fc-887d-69476cce343b req-5751f98c-320b-4f1e-a97f-2a2688fe6e73 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.844059 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9a27ef8f-5e42-43c5-b786-2a4c5d899038 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments/2cdf1939-2ca1-4748-abbd-df54d957e77a" status: 202 len: 0 microversion: 2.20 time: 0.290957 Aug 27 03:35:51.845007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 509/1076] 10.222.0.58 () {60 vars in 1457 bytes} [Fri Aug 27 03:35:51 2021] DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments/2cdf1939-2ca1-4748-abbd-df54d957e77a => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:51.850846 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.compute.server_external_events [req-b99804d3-a6d1-43fc-887d-69476cce343b req-5751f98c-320b-4f1e-a97f-2a2688fe6e73 service nova] Unable to find a host for instance 46d79045-6606-4046-b902-58e716cb2375. Dropping event network-vif-unplugged {{(pid=108336) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 27 03:35:51.851896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-b99804d3-a6d1-43fc-887d-69476cce343b req-5751f98c-320b-4f1e-a97f-2a2688fe6e73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030188 Aug 27 03:35:51.852507 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 568/1077] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 03:35:51.904902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:51.905468 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:51.912759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.913313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.914097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.914834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.972940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:51.974116 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:51.980440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.980867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.981639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:51.982120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:51.994659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f02f47f7-781a-469c-b6f7-e28cbfe16be9 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action" status: 202 len: 0 microversion: 2.20 time: 0.093593 Aug 27 03:35:51.998726 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 510/1078] 10.222.0.58 () {62 vars in 1319 bytes} [Fri Aug 27 03:35:51 2021] POST /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:52.003289 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.003919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:52.010703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:52.011142 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:52.011955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:52.012471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:52.071228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d17877b3-d6c3-49fd-b0f7-f743d60ae687 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 25475 microversion: 2.1 time: 0.102072 Aug 27 03:35:52.072010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 569/1079] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:51 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 25475 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:52.138596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.146641 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.148188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.149315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a3ba7ffc-5767-42c1-bef7-98787338579d tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1670 microversion: 2.20 time: 0.149601 Aug 27 03:35:52.149879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 511/1080] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:51 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:53.083334 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:53.084404 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:53.091997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.092565 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.093375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.094031 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.167089 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.167739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:53.173782 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.174220 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.174966 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:53.175569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:53.178166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c1b6f6bf-1a5c-43d4-bfbc-6e060dca2622 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 26526 microversion: 2.1 time: 0.098811 Aug 27 03:35:53.179389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 570/1081] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:53 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 26526 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:53.602123 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.610436 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.612084 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.613620 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c70799d4-e2c9-412c-a77a-246df38598bd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.449924 Aug 27 03:35:53.614219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 512/1082] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:53 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:54.190816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:54.191965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:54.198949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.199387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:54.200193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.200624 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:54.283309 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0a70143b-3ecd-4c9b-9e6d-35e1f25b143c tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 27325 microversion: 2.1 time: 0.096371 Aug 27 03:35:54.284762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 571/1083] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:54 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 27325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:35:54.634357 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:54.636610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:54.647639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.648086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:54.648864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:54.649293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:54.814104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.823594 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.825383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.826550 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-901b2938-ad38-46d2-a1ac-fb11cd63f718 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.196095 Aug 27 03:35:54.827115 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 513/1084] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:54 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:55.296051 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:55.297039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:55.304432 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:55.304875 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:55.305638 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:55.306065 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:55.845010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:55.845564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:55.852271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:55.852702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:55.853455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:55.853875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:56.013451 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.023290 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.024994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.026288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f25419d1-6467-4b44-a478-57a76c2a9f34 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.185046 Aug 27 03:35:56.031529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 514/1085] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:55 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:57.048979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.049714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:57.057026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:57.057440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:57.058228 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:57.058648 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:57.198413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.206904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.208424 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.209571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-44d03bf6-774d-47cc-8302-38b4de41746f tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.166970 Aug 27 03:35:57.210124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 515/1086] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:57 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:58.229149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:58.231527 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:58.239920 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:58.240390 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:58.241621 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:58.242126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:58.376107 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.384708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.386177 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.387376 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fd682b2e-1487-481d-b3d4-5fb4686d4c38 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.163052 Aug 27 03:35:58.388145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 516/1087] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:58 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:59.406078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:59.406834 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:35:59.413686 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:59.414242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:59.415146 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:35:59.415696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:59.546698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.557315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.558814 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.560011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-9699ec9e-c973-4356-8ddd-0bc13b032eaa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.158024 Aug 27 03:35:59.561009 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 517/1088] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:35:59 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:00.579120 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:00.579951 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:00.587201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:00.587678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:00.588877 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:00.589375 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:00.721652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.731896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.734029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.735760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-65c90e45-2856-4639-a4d6-70ecbc2dbb66 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.160823 Aug 27 03:36:00.737011 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 518/1089] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:00 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:01.756969 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.757729 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:01.763777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:01.764218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:01.764959 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:01.765377 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:01.906820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.915408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.916890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.918014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ddf82121-cb6a-4fd3-ad82-ccbc5a522079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.167201 Aug 27 03:36:01.918571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 519/1090] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:01 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:02.067678 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:02.068720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:02.075197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.075665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.076437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.076860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.152654 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f1f0b92c-9007-4df1-bc68-5f3de46bfa43 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.088646 Aug 27 03:36:02.156884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 520/1091] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:02 2021] POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:02.165450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:02.166543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:02.173993 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.174722 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.175756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.176720 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.314560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.322998 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c4daeece-7bac-4356-a698-4bb75c49eda6 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1750 microversion: 2.1 time: 0.162127 Aug 27 03:36:02.332801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 521/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:02 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:02.937453 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:02.938307 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:02.945028 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.945492 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:02.946260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:02.946689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:03.095583 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.111032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.112601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.113769 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-022500c9-52a7-425c-8d7b-017304b25df1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.180176 Aug 27 03:36:03.114338 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 522/1093] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:02 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:03.339907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:03.340450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:03.346471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:03.346908 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:03.347680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:03.348096 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:03.479747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.488382 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b44b549e-5fac-4dcf-9147-b9010eb1b4ac tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1750 microversion: 2.1 time: 0.152215 Aug 27 03:36:03.496635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 523/1094] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:03 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:04.133812 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.134560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:04.140970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:04.141452 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:04.142218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:04.142650 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:04.308625 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.326436 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.330077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.332387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f97a9f7b-88c0-425b-9990-a22f3b0dc545 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.202430 Aug 27 03:36:04.343020 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 524/1095] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:04 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:04.506030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.506773 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:04.512888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:04.513334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:04.514097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:04.514526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:04.644587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.653168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d018f54a-13b1-4f75-a6a2-8d0ed6a96447 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1750 microversion: 2.1 time: 0.150882 Aug 27 03:36:04.653662 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 525/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:04 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:05.350725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.351494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:05.357432 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:05.357878 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:05.358639 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:05.359068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:05.500181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.510043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.512275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.513595 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ea497b39-b8af-4789-8c9f-80969de01e89 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.167061 Aug 27 03:36:05.514145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 526/1097] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:05 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:05.674556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.675981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:05.689725 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:05.690499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:05.691793 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:05.693038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:05.847289 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.855369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f2c08217-d86e-4491-b87d-da9f9fa14754 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1750 microversion: 2.1 time: 0.187879 Aug 27 03:36:05.855950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 527/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:05 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:06.533480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.534316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:06.542743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:06.543547 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:06.544963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:06.545407 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:06.686766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.697312 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.699165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.700850 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6ff267b3-fecc-4f33-a71b-4d6808ef4079 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.171120 Aug 27 03:36:06.701605 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 528/1099] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:06 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:06.874392 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.875152 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:06.884188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:06.884818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:06.885940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:06.886597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:07.022347 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.030963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-62a98aad-9736-465e-995b-b4c569dec8b4 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1750 microversion: 2.1 time: 0.160853 Aug 27 03:36:07.031530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 529/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:06 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:07.256055 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-22672721-c491-4e05-9044-3a208d599682 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 29803 microversion: 2.1 time: 11.963738 Aug 27 03:36:07.256767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 572/1101] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:35:55 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 29803 bytes in 11966 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:07.719748 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.720459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:07.726691 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:07.727148 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:07.728205 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:07.728636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:07.916941 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.925443 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.927513 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.929545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-28a9ca30-dd4f-49d3-ba23-10e3a2308936 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.213387 Aug 27 03:36:07.930450 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 530/1102] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:07 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:08.048387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.049500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.057497 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.057978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.058748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.059178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.198448 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.211675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-20eed8bc-a555-40c1-b280-150cceda6ced tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.167148 Aug 27 03:36:08.212436 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 573/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:08 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.268858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:08.269852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.276487 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.276936 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.277706 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.278135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.362135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f27d6e66-f20b-41e8-9658-2e4d237e3515 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 31246 microversion: 2.1 time: 0.096828 Aug 27 03:36:08.362749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 531/1104] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:08 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 31246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:08.953773 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.954425 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:08.961749 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.962256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:08.963104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:08.963643 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.095303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.103752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.105246 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.106387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0c3e2caa-df95-4ddc-a83b-ec87f48ffa80 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.156636 Aug 27 03:36:09.106919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 574/1105] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:08 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:09.238974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.240288 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:09.251286 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.252068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.253304 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.254002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.378907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:09.379982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:09.386045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.386494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.387302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:09.387730 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:09.406687 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.414561 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-b95cb0ed-3734-4109-9912-8e4e61724f5a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.182493 Aug 27 03:36:09.415134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 532/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:09 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:09.474004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7212f4cd-84b2-4eeb-9b72-83da5b6534a5 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 32874 microversion: 2.1 time: 0.098697 Aug 27 03:36:09.475035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 575/1107] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:09 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 32874 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:10.127117 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.127948 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:10.139548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.139994 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.140759 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.141187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.272980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.281048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.282565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.283931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-48c69cd0-3620-4d89-a523-dc61e192eef7 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.163114 Aug 27 03:36:10.284526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 533/1108] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:10 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:10.433115 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.433795 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:10.440702 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.441136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.441877 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.442284 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.486315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:10.487223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:10.493742 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.494216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.494999 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:10.495438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:10.574139 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-26db6121-7b46-420c-8434-23e430c52e86 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 33667 microversion: 2.1 time: 0.091296 Aug 27 03:36:10.575173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 534/1109] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:10 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 33667 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:36:10.580487 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.589397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-34f1ce17-d562-447d-b035-8094b387f850 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.160453 Aug 27 03:36:10.589954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 576/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:10 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.303483 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.304164 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:11.311015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.311481 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.312235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.312656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.450413 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.459211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.460739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.461864 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1073f385-762f-44a0-9d0c-ddc57f0e01b6 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.163421 Aug 27 03:36:11.462422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 535/1111] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:11 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:11.590587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:11.592101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:11.602310 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.602752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.603580 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.604011 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.611069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.611703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:11.617902 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.618322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.619097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.619553 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:11.691468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-14ad5c80-03df-433d-a82f-144e3055986d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 34595 microversion: 2.1 time: 0.107490 Aug 27 03:36:11.692230 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 577/1112] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:11 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 34595 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:11.751073 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.759855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0eb004d5-94e5-4fbd-9e2a-a455d3e9f457 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.152420 Aug 27 03:36:11.760422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 536/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:11 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.975652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-577928f4-148c-4e9e-9f2e-6e3c0cd4c860 req-727c027f-7e44-4f2a-8dca-d755ccccfc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "name": "network-vif-plugged", "status": "completed", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:11.977151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:11.977151 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:36:11.988021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-577928f4-148c-4e9e-9f2e-6e3c0cd4c860 req-727c027f-7e44-4f2a-8dca-d755ccccfc60 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:11.988708 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-577928f4-148c-4e9e-9f2e-6e3c0cd4c860 req-727c027f-7e44-4f2a-8dca-d755ccccfc60 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.004624 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-577928f4-148c-4e9e-9f2e-6e3c0cd4c860 req-727c027f-7e44-4f2a-8dca-d755ccccfc60 service nova] Creating event network-vif-plugged:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:36:12.011329 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-577928f4-148c-4e9e-9f2e-6e3c0cd4c860 req-727c027f-7e44-4f2a-8dca-d755ccccfc60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039563 Aug 27 03:36:12.012191 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 578/1114] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:12.484436 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.485268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:12.496504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.497229 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.498466 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.499163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.644542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.655183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.657549 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.659252 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d952fdfb-5d31-4cab-8c83-967acbcf7a49 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.180835 Aug 27 03:36:12.660036 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 537/1115] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:12 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:12.704727 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:12.705744 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:12.712719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.713164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.713919 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.714343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.780967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.781955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:12.792405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.793169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.794428 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:12.794665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ff03c9bf-7a0b-4d3e-b726-999eff45acac tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 35468 microversion: 2.1 time: 0.093416 Aug 27 03:36:12.795173 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:12.801683 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 579/1116] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:12 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 35468 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:12.921791 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.930633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-165fa854-8302-448e-ad56-33e0d14bf335 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.156041 Aug 27 03:36:12.931227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 538/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:12 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:13.679862 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.680542 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:13.688190 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.688610 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.689372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.689805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.809503 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:13.810881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:13.816863 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.817744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.819610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.820217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.827046 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:13.845751 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:13.847241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:13.848418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-06b711ff-65ef-4fc6-b6b1-f084c2d68368 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1728 microversion: 2.20 time: 0.174096 Aug 27 03:36:13.849007 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 580/1118] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:13 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:13.919626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fbd06f8b-5c0e-4f68-b4d8-35c9cc467df0 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 36554 microversion: 2.1 time: 0.113565 Aug 27 03:36:13.920255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 539/1119] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:13 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 36554 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:13.947375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.947977 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:13.953794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.954233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:13.954985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:13.955444 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.090412 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.098786 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-de5c6ce4-7633-4464-9964-9390a060f248 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.155178 Aug 27 03:36:14.099411 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 581/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:13 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:14.870582 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:14.871378 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:14.881488 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.882067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.883094 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.883659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.932066 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:14.932981 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:14.939377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.939842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:14.940628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:14.941045 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.015546 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9ca9c5c1-8ce4-414b-8203-b679624e729b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 37831 microversion: 2.1 time: 0.086916 Aug 27 03:36:15.019935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 582/1121] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:14 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 37831 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:15.020104 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.026257 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.027760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.028892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fce29b7c-ca03-4466-93c3-88a9342dbfa4 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1715 microversion: 2.20 time: 0.162524 Aug 27 03:36:15.029411 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 540/1122] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:14 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:15.119880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.120732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:15.130511 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.131107 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.132233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:15.132822 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:15.275690 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.283759 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-247fb6e2-b9f3-4bfd-8f56-e4a4231a1ff1 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.170289 Aug 27 03:36:15.284362 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 583/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:15 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.032370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:16.033825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:16.042287 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.042737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.043543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.044008 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.125409 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-72cf6511-bb24-4074-a4e8-5934f782ac56 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 38204 microversion: 2.1 time: 0.099146 Aug 27 03:36:16.126308 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 541/1124] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:16 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 38204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:36:16.306026 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.306649 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:16.313241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.313693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.314464 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:16.314896 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:16.459512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.472085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-133d3562-6877-4e94-b8e2-b20ce0640e5b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.171769 Aug 27 03:36:16.472990 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 584/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:16 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:17.144683 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:17.146291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:17.154322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.154795 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.155640 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.156074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.219158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ab0181b3-14a6-483a-9392-7d230319d708 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 38204 microversion: 2.1 time: 0.081952 Aug 27 03:36:17.219905 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 542/1126] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:17 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 38204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:17.503004 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:17.504245 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:17.511805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.512248 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.513021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:17.513434 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:17.652765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.664962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-57e59e3f-bb89-45c2-b06a-33dbdee99f0b tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.169884 Aug 27 03:36:17.665534 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 585/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:17 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:18.232557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:18.233562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:18.240545 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.240978 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.241737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.242157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.308881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f2989828-995a-481b-8046-6e9a847c8257 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 38204 microversion: 2.1 time: 0.079838 Aug 27 03:36:18.309751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 543/1128] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:18 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 38204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:18.682823 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:18.683485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:18.690177 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.690624 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.691380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:18.691829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:18.828177 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.836419 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8e204e9c-8bf0-4e52-8624-6cc05dc7918f tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.157325 Aug 27 03:36:18.836962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 586/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:18 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:19.327883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:19.329818 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:19.339103 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.339597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.340370 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.340803 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.415737 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6b7cd65c-33c0-4317-abd1-47202674888a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action" status: 200 len: 38333 microversion: 2.1 time: 0.094534 Aug 27 03:36:19.416389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 544/1130] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:36:19 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/action => generated 38333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:36:19.426645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.427133 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:19.433821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.434265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.435037 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.435529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.458630 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-556163ab-5e0c-419c-9da8-436a2b748929 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/ips" status: 200 len: 146 microversion: 2.1 time: 0.036076 Aug 27 03:36:19.459202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 587/1131] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:36:19 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:19.854956 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.855627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:19.862420 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.862861 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:19.863666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:19.864095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.013538 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:20.021387 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-adcadb08-af1a-4450-86c0-214c9c284e13 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.170967 Aug 27 03:36:20.021954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 545/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:19 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:20.834547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddf229ee-1a6f-4bea-9ee6-d09a426938ed"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:20.836241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:20.842828 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.843377 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:20.844173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:20.844598 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:21.037774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:21.038570 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:21.045301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:21.045750 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:21.046514 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:21.046942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:21.120389 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-25fa8d90-fd66-4230-b7ba-03721e433375 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291966 Aug 27 03:36:21.121431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 588/1133] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:36:20 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:21.178553 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.190459 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8ea39f04-df85-4058-8b46-2a967e55a168 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.156246 Aug 27 03:36:21.191016 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 546/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:21 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:22.213215 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.214353 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:22.225538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.226187 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.226586 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:22.227028 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:22.370791 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.378927 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-75e14827-d61b-40ea-a58e-33306bdb4d4d tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.172850 Aug 27 03:36:22.379512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 589/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:22 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:23.396820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:23.397977 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:23.405799 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.406245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.407215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:23.407702 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:23.541181 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.553832 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c22e1a77-989d-4830-8db5-509a9291ff75 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1755 microversion: 2.1 time: 0.160756 Aug 27 03:36:23.554652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 547/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:23 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:24.580583 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.581613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:24.589525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.589944 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:24.590704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:24.591409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:24.727669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.735938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-74bcf855-61b3-4166-b60c-83d2c4fc6f38 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1758 microversion: 2.1 time: 0.161432 Aug 27 03:36:24.736778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 590/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:24 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:28.736658 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.737560 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:28.744266 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.744704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.745467 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.745892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.775140 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-4c572dc0-9f95-43cd-9e4e-d55a05344441 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042231 Aug 27 03:36:28.775719 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 548/1138] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:36:28 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:28.785560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.786079 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:28.793397 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.793844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.794607 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:28.795036 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:28.831334 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-18cd3428-7328-495d-9988-8d5bc0ce491e tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed" status: 200 len: 194 microversion: 2.1 time: 0.049588 Aug 27 03:36:28.831935 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 591/1139] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Aug 27 03:36:28 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:30.174596 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6279456a-b91a-4f93-bd5d-40f8ecc85b1c"}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:30.175666 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:30.182353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.182760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.183541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:30.183963 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:30.471132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6dc24a8c-26ae-4fa8-90fb-d1b33b3ed8b1 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300136 Aug 27 03:36:30.471820 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 549/1140] 10.222.0.58 () {60 vars in 1323 bytes} [Fri Aug 27 03:36:30 2021] POST /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:38.097409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.098391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:38.105309 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.105672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.106433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.106857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.140060 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b0021760-438d-429f-80f3-83273e76335a tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046213 Aug 27 03:36:38.140794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 592/1141] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:36:38 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:38.413465 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.414069 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:38.420584 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.421132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.421894 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.422318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.452438 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-254a052c-b45a-42ae-a54c-858357c177d8 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed" status: 200 len: 194 microversion: 2.1 time: 0.043597 Aug 27 03:36:38.455053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 550/1142] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Aug 27 03:36:38 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:38.462930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.463474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:38.469853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.470409 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.471186 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:38.471644 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:38.558435 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lazy-loading 'services' on Instance uuid 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:36:38.642222 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3753b982-93bf-4f3d-b526-caa2edef076f tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed" status: 202 len: 0 microversion: 2.1 time: 0.183058 Aug 27 03:36:38.642839 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 593/1143] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:36:38 2021] DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/ddf229ee-1a6f-4bea-9ee6-d09a426938ed => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:40.839634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:40.840194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:40.846610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.847047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:40.847832 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.848251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:40.891712 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fc152c74-5f42-48d2-a422-b5c6f7d10818 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/6279456a-b91a-4f93-bd5d-40f8ecc85b1c" status: 200 len: 194 microversion: 2.1 time: 0.056243 Aug 27 03:36:40.892293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 551/1144] 10.222.0.58 () {58 vars in 1413 bytes} [Fri Aug 27 03:36:40 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/6279456a-b91a-4f93-bd5d-40f8ecc85b1c => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:40.903209 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:40.903794 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:40.910982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.911455 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:40.912217 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:40.912646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:41.008842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lazy-loading 'services' on Instance uuid 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:36:41.092847 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f9d19fb4-d17b-48f4-acb9-a00e4bf0d18b tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/6279456a-b91a-4f93-bd5d-40f8ecc85b1c" status: 202 len: 0 microversion: 2.1 time: 0.193964 Aug 27 03:36:41.093781 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 594/1145] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:36:40 2021] DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments/6279456a-b91a-4f93-bd5d-40f8ecc85b1c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:42.276354 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.277306 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:42.283747 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.284186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.284928 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.285349 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.316192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5d418101-8967-4c0e-b574-090ee33413ff tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043560 Aug 27 03:36:42.316727 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 552/1146] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:36:42 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:36:42.444662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.445704 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:42.452366 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.452788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.453533 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.453983 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.482554 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d92458f5-c037-40de-b1d4-aa653bd07922 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042011 Aug 27 03:36:42.483092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 595/1147] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:36:42 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:36:42.552875 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.553564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:42.560565 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.561007 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.561753 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.562182 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.586278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:36:42.668536 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-29918c91-ed5c-4250-bf1d-ab7bcbc15191 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 204 len: 0 microversion: 2.1 time: 0.121579 Aug 27 03:36:42.669188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 553/1148] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:36:42 2021] DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:42.677696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.678432 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:42.685121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.685493 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.686247 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:42.686666 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:42.826511 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:42.834570 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e5a80239-019a-42e9-9534-fb0bd6048292 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1673 microversion: 2.1 time: 0.161106 Aug 27 03:36:42.835129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 596/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:42 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:43.855831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:43.856576 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:43.863455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:43.863923 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:43.864715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:43.865162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:44.005115 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.017985 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2de73a35-382a-41e0-9fc1-d188b675c51d tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1673 microversion: 2.1 time: 0.167943 Aug 27 03:36:44.018906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 554/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:43 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:45.040905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:45.041521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:45.048962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:45.049394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:45.050185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:45.051048 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:45.274523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:45.282594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-450f5065-d773-4f6a-aa20-ccb4c3501efc tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1673 microversion: 2.1 time: 0.247884 Aug 27 03:36:45.283303 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 597/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:45 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:45.728275 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-f6ec2fde-f92a-4cae-a5b4-c7d13942361e req-e752b001-6a0f-44c6-9470-33c48e9d94a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e8fdbe-3d56-4b42-967b-5d8bbf0e281e", "name": "network-vif-deleted", "tag": "5dd572f1-816d-41f0-bfc3-8a5318f6cc06"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:45.731844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:45.731844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:36:45.747241 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f6ec2fde-f92a-4cae-a5b4-c7d13942361e req-e752b001-6a0f-44c6-9470-33c48e9d94a3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:45.747770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f6ec2fde-f92a-4cae-a5b4-c7d13942361e req-e752b001-6a0f-44c6-9470-33c48e9d94a3 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:45.770332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-f6ec2fde-f92a-4cae-a5b4-c7d13942361e req-e752b001-6a0f-44c6-9470-33c48e9d94a3 service nova] Creating event network-vif-deleted:5dd572f1-816d-41f0-bfc3-8a5318f6cc06 for instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e on hv-cinder-80473 Aug 27 03:36:45.781217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-f6ec2fde-f92a-4cae-a5b4-c7d13942361e req-e752b001-6a0f-44c6-9470-33c48e9d94a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060672 Aug 27 03:36:45.784043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 555/1152] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:46.301018 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:46.302405 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:46.308715 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:46.309257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:46.310262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:46.310771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:46.345078 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:46.345520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:46.345959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lazy-loading 'fault' on Instance uuid 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:36:46.393166 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8979c080c54e9096de897a22ba40b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527dc9638ff74cfda148b7cf1b61c6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:46.400849 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4434d81c-5bdb-4f3c-babf-619c221911c4 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 200 len: 1327 microversion: 2.1 time: 0.104081 Aug 27 03:36:46.402016 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 598/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:46 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:47.418971 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:47.419996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:47.426913 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:47.427381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:47.428163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:47.428586 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:47.442245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. Aug 27 03:36:47.442847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:47.443689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-fe2b66d9-c556-47c8-ba37-aa108c05bd05 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 404 len: 111 microversion: 2.1 time: 0.028907 Aug 27 03:36:47.444219 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 556/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:47 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:47.452734 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-26a80b31-9d33-4900-8cc8-34e69b07fbfb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '.version_select at 0x7f6cfc2589d0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:47.472494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-26a80b31-9d33-4900-8cc8-34e69b07fbfb tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821334418" status: 202 len: 0 microversion: 2.1 time: 0.023524 Aug 27 03:36:47.473238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 599/1155] 10.222.0.58 () {58 vars in 1221 bytes} [Fri Aug 27 03:36:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821334418 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:48.636052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:48.636760 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:48.638885 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-556f0577-5b15-47f5-a630-e4c7edaafc22 req-aede4b9f-c33a-4198-b684-2cd99b87ee44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:48.640500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:48.640500 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:36:48.643933 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.644627 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.645510 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.646030 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.648251 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-556f0577-5b15-47f5-a630-e4c7edaafc22 req-aede4b9f-c33a-4198-b684-2cd99b87ee44 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.648698 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-556f0577-5b15-47f5-a630-e4c7edaafc22 req-aede4b9f-c33a-4198-b684-2cd99b87ee44 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.663667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-556f0577-5b15-47f5-a630-e4c7edaafc22 req-aede4b9f-c33a-4198-b684-2cd99b87ee44 service nova] Creating event network-changed:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:36:48.670632 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-556f0577-5b15-47f5-a630-e4c7edaafc22 req-aede4b9f-c33a-4198-b684-2cd99b87ee44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035808 Aug 27 03:36:48.672072 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 600/1156] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:48.672831 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:36:48.763021 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-798128de-623e-4ead-9153-f66b0610e99e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 204 len: 0 microversion: 2.1 time: 0.130322 Aug 27 03:36:48.765170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 557/1157] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:36:48 2021] DELETE /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:48.775560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:48.776558 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:48.783544 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.784309 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.785340 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:48.785988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:48.997400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.005760 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-be62eae6-8ec8-440c-969d-d0c99dcdc9a5 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1568 microversion: 2.1 time: 0.234597 Aug 27 03:36:49.006368 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 601/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:48 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.028679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.029974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:50.036751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.037196 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.037968 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.038389 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.178041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.188172 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ca76807e-a2f5-4346-a331-c5e43dc85f5e tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1449 microversion: 2.1 time: 0.166512 Aug 27 03:36:50.188744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 558/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:50 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.411717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.412267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:50.418960 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.419435 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.420210 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.420640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.435785 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. Aug 27 03:36:50.436400 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:50.437757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-91565237-553d-4952-b73c-2c3edec38ea9 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 404 len: 111 microversion: 2.1 time: 0.029989 Aug 27 03:36:50.438307 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 602/1160] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:36:50 2021] DELETE /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:50.449031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.449943 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:50.457105 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.457556 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.458303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:50.458724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:50.472237 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. Aug 27 03:36:50.472808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance 05e8fdbe-3d56-4b42-967b-5d8bbf0e281e could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:50.473624 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a8a1368b-d2b9-4c8e-8b61-81917a3bc593 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e" status: 404 len: 111 microversion: 2.1 time: 0.030756 Aug 27 03:36:50.474152 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 559/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:50 2021] GET /compute/v2.1/servers/05e8fdbe-3d56-4b42-967b-5d8bbf0e281e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:51.205895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:51.206568 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:51.212905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.213343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.214280 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.214714 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.304634 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7811e8849c74b2b9aa9182bec90fc7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c43de7a6384b82b35f14a762da5d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:51.312529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f9cbfde1-7875-4c90-a2b8-f2e15761ebb3 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 200 len: 1382 microversion: 2.1 time: 0.110519 Aug 27 03:36:51.313102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 603/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:51 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 1382 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:51.336060 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-a9b9e997-4e05-4078-9c47-3b0b80a78b99 req-e4c211cc-eb6d-4e55-9f7b-95f95fe1236d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25b26f8-5e31-4626-bda8-a9cec1e654fc", "name": "network-vif-deleted", "tag": "9af3d873-dcf5-4498-b710-974f39d1ebae"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:51.338048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:51.338048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:36:51.346529 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a9b9e997-4e05-4078-9c47-3b0b80a78b99 req-e4c211cc-eb6d-4e55-9f7b-95f95fe1236d service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.346957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-a9b9e997-4e05-4078-9c47-3b0b80a78b99 req-e4c211cc-eb6d-4e55-9f7b-95f95fe1236d service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.359557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-a9b9e997-4e05-4078-9c47-3b0b80a78b99 req-e4c211cc-eb6d-4e55-9f7b-95f95fe1236d service nova] Creating event network-vif-deleted:9af3d873-dcf5-4498-b710-974f39d1ebae for instance e25b26f8-5e31-4626-bda8-a9cec1e654fc on hv-cinder-80473 Aug 27 03:36:51.364798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-a9b9e997-4e05-4078-9c47-3b0b80a78b99 req-e4c211cc-eb6d-4e55-9f7b-95f95fe1236d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 Aug 27 03:36:51.365369 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 560/1163] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:51.624372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:51.624978 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:51.631589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.632093 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.632803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.633228 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.650099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. Aug 27 03:36:51.650725 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:51.651668 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-cfcec3a0-2226-4d7b-8f48-35c20248d124 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 404 len: 111 microversion: 2.1 time: 0.031991 Aug 27 03:36:51.652240 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 604/1164] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:36:51 2021] DELETE /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:51.662315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:51.663015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] [instance: b798f8be-ccdf-4eec-b4dc-9216b13eba31] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:51.670239 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.670704 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.671947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:51.672368 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:51.689193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] HTTP exception thrown: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. Aug 27 03:36:51.689869 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] Returning 404 to user: Instance b798f8be-ccdf-4eec-b4dc-9216b13eba31 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:51.690899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ce4cf5b0-1da3-4534-9406-09f390325688 tempest-AttachVolumeTestJSON-1563266792 tempest-AttachVolumeTestJSON-1563266792-project] 10.222.0.58 "GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31" status: 404 len: 111 microversion: 2.1 time: 0.033974 Aug 27 03:36:51.695091 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 561/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:51 2021] GET /compute/v2.1/servers/b798f8be-ccdf-4eec-b4dc-9216b13eba31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:52.329684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.330428 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] [instance: e25b26f8-5e31-4626-bda8-a9cec1e654fc] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:52.336776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:52.337179 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:52.337950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:52.338413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:52.352312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] HTTP exception thrown: Instance e25b26f8-5e31-4626-bda8-a9cec1e654fc could not be found. Aug 27 03:36:52.352906 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Returning 404 to user: Instance e25b26f8-5e31-4626-bda8-a9cec1e654fc could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:52.353741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9cfa1aa0-a9e6-4eee-b7fc-aea64f73c3d4 tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc" status: 404 len: 111 microversion: 2.1 time: 0.028630 Aug 27 03:36:52.354285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 605/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:52 2021] GET /compute/v2.1/servers/e25b26f8-5e31-4626-bda8-a9cec1e654fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:52.515151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-175abde4-c1dc-4490-9c73-59eabc1fc5ca tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] Calling method '.version_select at 0x7f6cfc0f7b80>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.551987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-175abde4-c1dc-4490-9c73-59eabc1fc5ca tempest-TestShelveInstance-670025251 tempest-TestShelveInstance-670025251-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-831302725" status: 202 len: 0 microversion: 2.1 time: 0.040569 Aug 27 03:36:52.552641 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 562/1167] 10.222.0.58 () {58 vars in 1251 bytes} [Fri Aug 27 03:36:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-831302725 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:53.306427 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:53.307551 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:53.314085 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.314594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.315305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.315764 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.347164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f4a283b6-a91d-46c7-95e1-2e5e1c85adfd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044630 Aug 27 03:36:53.348052 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 606/1168] 10.222.0.58 () {60 vars in 1343 bytes} [Fri Aug 27 03:36:53 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:53.416023 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:53.416897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:53.424313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.424802 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.426454 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.427048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.456986 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:36:53.548680 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dc48ab44-bffd-40c7-afbc-244ec3110daa tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 204 len: 0 microversion: 2.20 time: 0.136249 Aug 27 03:36:53.551214 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 563/1169] 10.222.0.58 () {60 vars in 1280 bytes} [Fri Aug 27 03:36:53 2021] DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:36:53.559128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:53.560367 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:53.567255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.567985 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.568940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:53.569545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:53.893525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.901613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.903094 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.904283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b65956d3-5f9a-44f1-a678-856ec41365fd tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.348857 Aug 27 03:36:53.904820 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 607/1170] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:53 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:54.925559 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:54.926654 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:54.936326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:54.936876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:54.938247 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:54.939502 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:55.199043 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:55.208301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:55.209792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:55.210940 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-978062fc-0642-4b86-a91c-0410d36ef3b1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1721 microversion: 2.20 time: 0.290267 Aug 27 03:36:55.211838 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 564/1171] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:54 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:56.174667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-725127da-241f-4de0-b184-b98be1115d80 req-0b95712a-b63f-458b-85b5-efb46e333511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d79045-6606-4046-b902-58e716cb2375", "name": "network-vif-deleted", "tag": "d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:56.177431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:36:56.177431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:36:56.186343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-725127da-241f-4de0-b184-b98be1115d80 req-0b95712a-b63f-458b-85b5-efb46e333511 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:56.186793 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-725127da-241f-4de0-b184-b98be1115d80 req-0b95712a-b63f-458b-85b5-efb46e333511 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.212672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-725127da-241f-4de0-b184-b98be1115d80 req-0b95712a-b63f-458b-85b5-efb46e333511 service nova] Creating event network-vif-deleted:d5b2a8c0-6b4b-4cd6-b54e-8c7f7c37ea9e for instance 46d79045-6606-4046-b902-58e716cb2375 on hv-cinder-80473 Aug 27 03:36:56.221997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-725127da-241f-4de0-b184-b98be1115d80 req-0b95712a-b63f-458b-85b5-efb46e333511 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052556 Aug 27 03:36:56.228410 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 608/1172] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:56.232217 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:56.233244 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:56.241549 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:56.242867 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.244315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:56.244947 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:56.348604 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.359659 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.361249 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75cb79bac8944976a2689f62b8d014e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ccdbc7dbb46c6abacc312e57220a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.362801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-40911e58-04bb-46fd-9fcd-6f6f1d645a4b tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 200 len: 1364 microversion: 2.20 time: 0.135989 Aug 27 03:36:56.364267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 565/1173] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:56 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 1364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:57.386418 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:57.388180 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:57.411592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:57.412259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:57.413265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:57.413696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:57.461737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. Aug 27 03:36:57.462517 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:57.463380 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-9888b837-eb4b-48d3-8a3e-33a3826d11b0 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 404 len: 111 microversion: 2.20 time: 0.083349 Aug 27 03:36:57.467860 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 609/1174] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Aug 27 03:36:57 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:36:57.473170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-809aaffc-1601-4ca0-beb2-b8a05c30a9f8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '.version_select at 0x7f6cfc0ea550>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:57.501731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-809aaffc-1601-4ca0-beb2-b8a05c30a9f8 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39295384" status: 204 len: 0 microversion: 2.20 time: 0.031803 Aug 27 03:36:57.507918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 566/1175] 10.222.0.58 () {60 vars in 1256 bytes} [Fri Aug 27 03:36:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39295384 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:36:58.167508 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fd58cb83-b985-4113-b1ca-36dd10b1127e tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Action: 'create', calling method: .version_select at 0x7f6cfc258b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1789894530", "metadata": {"Type": "work"}}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:58.522675 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fd58cb83-b985-4113-b1ca-36dd10b1127e tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.511163 Aug 27 03:36:58.523616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 610/1176] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:36:58 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:36:58.540797 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-13583125-27ec-4f84-91cb-515f7a12832d tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc0a2160>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:58.603155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-13583125-27ec-4f84-91cb-515f7a12832d tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 200 len: 353 microversion: 2.1 time: 0.070676 Aug 27 03:36:58.604176 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 567/1177] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:36:58 2021] GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:59.617302 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b0c95132-6e06-495f-8982-7b12f3a60150 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc25e8b0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.643833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.645758 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:59.653635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.654072 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.654839 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.655262 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.669832 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. Aug 27 03:36:59.670669 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:59.676569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6ae4dedb-6171-4942-a30a-51343a0edcf1 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 404 len: 111 microversion: 2.1 time: 0.037757 Aug 27 03:36:59.680772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 568/1178] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:36:59 2021] DELETE /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:36:59.686165 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.687242 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 46d79045-6606-4046-b902-58e716cb2375] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:36:59.694201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.695067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.697571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:36:59.698073 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:36:59.698202 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b0c95132-6e06-495f-8982-7b12f3a60150 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 200 len: 354 microversion: 2.1 time: 0.085152 Aug 27 03:36:59.698652 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 611/1179] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:36:59 2021] GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:59.712609 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-09d0f65f-0202-4b1c-b8ac-4e9df5da1d7a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc43d700>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.722129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. Aug 27 03:36:59.722732 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 46d79045-6606-4046-b902-58e716cb2375 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:36:59.723619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5abbec5c-f968-4c0b-a31d-fa9d341140f2 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375" status: 404 len: 111 microversion: 2.1 time: 0.041622 Aug 27 03:36:59.727768 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 569/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:36:59 2021] GET /compute/v2.1/servers/46d79045-6606-4046-b902-58e716cb2375 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:59.783720 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-09d0f65f-0202-4b1c-b8ac-4e9df5da1d7a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 200 len: 354 microversion: 2.1 time: 0.077024 Aug 27 03:36:59.785285 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 612/1181] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:36:59 2021] GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:59.802176 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-823f0192-37e8-4b17-805b-b8dff97e7f8a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc07a940>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.873469 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-823f0192-37e8-4b17-805b-b8dff97e7f8a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 202 len: 0 microversion: 2.1 time: 0.078347 Aug 27 03:36:59.874233 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 570/1182] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:36:59 2021] DELETE /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:59.884746 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f123ef77-b1c1-4c4c-a747-b2c466f6be4a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc256820>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.944231 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f123ef77-b1c1-4c4c-a747-b2c466f6be4a tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 200 len: 353 microversion: 2.1 time: 0.063121 Aug 27 03:36:59.944915 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 613/1183] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:36:59 2021] GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:00.893798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.894439 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:00.900440 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.900896 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.901622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.902092 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.916163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. Aug 27 03:37:00.916749 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:00.917610 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-90322d04-6f90-4df9-a287-08c5a4177674 tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 404 len: 111 microversion: 2.1 time: 0.027687 Aug 27 03:37:00.918131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 571/1184] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:37:00 2021] DELETE /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:00.927789 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.928525 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] [instance: 6b06c46a-59d4-4460-8c5c-8b1c0a34b987] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:00.935012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.935494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.936361 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:00.936669 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:00.951206 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] HTTP exception thrown: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. Aug 27 03:37:00.952075 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] Returning 404 to user: Instance 6b06c46a-59d4-4460-8c5c-8b1c0a34b987 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:00.953181 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-44bf230d-48c2-486e-a218-200605e444fb tempest-AttachVolumeShelveTestJSON-661112575 tempest-AttachVolumeShelveTestJSON-661112575-project] 10.222.0.58 "GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987" status: 404 len: 111 microversion: 2.1 time: 0.030092 Aug 27 03:37:00.953716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 614/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:00 2021] GET /compute/v2.1/servers/6b06c46a-59d4-4460-8c5c-8b1c0a34b987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:37:00.957029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-233db335-82f9-47be-bb42-8ba2da7a5e22 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Calling method '.version_select at 0x7f6cfc089a60>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.988131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-233db335-82f9-47be-bb42-8ba2da7a5e22 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] HTTP exception thrown: Volume 7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 could not be found. Aug 27 03:37:00.988701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-233db335-82f9-47be-bb42-8ba2da7a5e22 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] Returning 404 to user: Volume 7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:00.989520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-233db335-82f9-47be-bb42-8ba2da7a5e22 tempest-VolumesGetTestJSON-1015156605 tempest-VolumesGetTestJSON-1015156605-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156" status: 404 len: 109 microversion: 2.1 time: 0.036409 Aug 27 03:37:00.990070 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 572/1186] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:37:00 2021] GET /compute/v2.1/os-volumes/7c7d7da2-e0b4-44ca-9f0b-8dd2e1e43156 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:02.686858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-53dcc637-7e75-4433-99da-2bf4ae655182 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Action: 'create', calling method: .version_select at 0x7f6cfc272c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1513226150", "metadata": {"Type": "work"}}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:02.688394 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-53dcc637-7e75-4433-99da-2bf4ae655182 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.689249 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-53dcc637-7e75-4433-99da-2bf4ae655182 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144651 Aug 27 03:37:02.693015 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 615/1187] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:37:02 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:02.703458 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8682157b-a020-415d-9b6f-334a3f3a4785 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Action: 'create', calling method: .version_select at 0x7f6cfc07ad30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-185218981", "metadata": {"Type": "work"}}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:02.706234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8682157b-a020-415d-9b6f-334a3f3a4785 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.707077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8682157b-a020-415d-9b6f-334a3f3a4785 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008368 Aug 27 03:37:02.714403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 573/1188] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:37:02 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:02.718699 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f817f782-8b33-4009-a1be-27f7ce8e9866 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Action: 'create', calling method: .version_select at 0x7f6cfc43ddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-213817773", "metadata": {"Type": "work"}}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:02.720121 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f817f782-8b33-4009-a1be-27f7ce8e9866 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.721012 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f817f782-8b33-4009-a1be-27f7ce8e9866 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007839 Aug 27 03:37:02.721903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 616/1189] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:37:02 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:02.733265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8ccf1bf8-4d56-48c0-ba59-f7d9a056a1bb tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Calling method '.version_select at 0x7f6cfc089ca0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.767379 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-8ccf1bf8-4d56-48c0-ba59-f7d9a056a1bb tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] HTTP exception thrown: Volume tempest-invalid-495042846 could not be found. Aug 27 03:37:02.767987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8ccf1bf8-4d56-48c0-ba59-f7d9a056a1bb tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 404 to user: Volume tempest-invalid-495042846 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.769010 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8ccf1bf8-4d56-48c0-ba59-f7d9a056a1bb tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-495042846" status: 404 len: 98 microversion: 2.1 time: 0.041654 Aug 27 03:37:02.769578 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 574/1190] 10.222.0.58 () {58 vars in 1215 bytes} [Fri Aug 27 03:37:02 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-495042846 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:37:02.782819 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1df9a624-ae3e-428f-b256-78873d7aed6a tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004523 Aug 27 03:37:02.783867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 617/1191] 10.222.0.58 () {58 vars in 1140 bytes} [Fri Aug 27 03:37:02 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:37:02.793048 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-270dac35-232c-4d3d-9b6f-2b4205dbd92f tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003687 Aug 27 03:37:02.793571 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 575/1192] 10.222.0.58 () {58 vars in 1137 bytes} [Fri Aug 27 03:37:02 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 27 03:37:02.804951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d6f0ad7d-dd83-48ca-8789-6ef7236ebc5f tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Calling method '.version_select at 0x7f6cfc449310>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.841950 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-d6f0ad7d-dd83-48ca-8789-6ef7236ebc5f tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] HTTP exception thrown: Volume 49900a62-89d7-4584-8046-518af571031a could not be found. Aug 27 03:37:02.843271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d6f0ad7d-dd83-48ca-8789-6ef7236ebc5f tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 404 to user: Volume 49900a62-89d7-4584-8046-518af571031a could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.844495 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d6f0ad7d-dd83-48ca-8789-6ef7236ebc5f tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/49900a62-89d7-4584-8046-518af571031a" status: 404 len: 109 microversion: 2.1 time: 0.043724 Aug 27 03:37:02.845108 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 618/1193] 10.222.0.58 () {58 vars in 1248 bytes} [Fri Aug 27 03:37:02 2021] DELETE /compute/v2.1/os-volumes/49900a62-89d7-4584-8046-518af571031a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:02.855497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dacd213c-ac61-4b1f-8f0b-ca56b2ecd275 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Calling method '.version_select at 0x7f6cfc22b8b0>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.891225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-dacd213c-ac61-4b1f-8f0b-ca56b2ecd275 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] HTTP exception thrown: Volume 49a4fd73-e6d5-4011-9d33-49d1280a1ff6 could not be found. Aug 27 03:37:02.891890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dacd213c-ac61-4b1f-8f0b-ca56b2ecd275 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] Returning 404 to user: Volume 49a4fd73-e6d5-4011-9d33-49d1280a1ff6 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:02.892734 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dacd213c-ac61-4b1f-8f0b-ca56b2ecd275 tempest-VolumesNegativeTest-537246235 tempest-VolumesNegativeTest-537246235-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/49a4fd73-e6d5-4011-9d33-49d1280a1ff6" status: 404 len: 109 microversion: 2.1 time: 0.042122 Aug 27 03:37:02.893293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 576/1194] 10.222.0.58 () {58 vars in 1245 bytes} [Fri Aug 27 03:37:02 2021] GET /compute/v2.1/os-volumes/49a4fd73-e6d5-4011-9d33-49d1280a1ff6 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:03.715908 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-432645167"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:03.717873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:03.724777 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:03.725346 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:03.726134 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:03.726958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:03.944024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.network.security_group_api [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Removing security group 26b3cc1d-dbb6-40f4-8340-a1379f3a6b1d from port 9bb5206b-382a-4dac-a93b-17b51b935b5a Aug 27 03:37:04.517112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-39138073-55e0-4c34-b049-f07607e8b558 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.803522 Aug 27 03:37:04.523692 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 619/1195] 10.222.0.58 () {60 vars in 1278 bytes} [Fri Aug 27 03:37:03 2021] POST /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:04.550305 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-4379c755-31ff-40e7-8fda-7461b2c0a758 req-2aceb9d3-3586-4e4e-a292-c65b90dc1015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:04.552723 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:04.552723 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:04.582622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4379c755-31ff-40e7-8fda-7461b2c0a758 req-2aceb9d3-3586-4e4e-a292-c65b90dc1015 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:04.588812 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4379c755-31ff-40e7-8fda-7461b2c0a758 req-2aceb9d3-3586-4e4e-a292-c65b90dc1015 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:04.615962 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-4379c755-31ff-40e7-8fda-7461b2c0a758 req-2aceb9d3-3586-4e4e-a292-c65b90dc1015 service nova] Creating event network-changed:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:37:04.629845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-4379c755-31ff-40e7-8fda-7461b2c0a758 req-2aceb9d3-3586-4e4e-a292-c65b90dc1015 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083456 Aug 27 03:37:04.631041 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 577/1196] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:06.450129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.451620 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-4c2862bd-623a-4cf8-8fd0-e71f8ab84308 req-a0dfe7e4-6dbd-4dd2-8086-6e608fd73e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:06.452738 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:06.455216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:06.455216 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:06.463763 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.464538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.465478 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.465908 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.467756 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4c2862bd-623a-4cf8-8fd0-e71f8ab84308 req-a0dfe7e4-6dbd-4dd2-8086-6e608fd73e98 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.468686 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4c2862bd-623a-4cf8-8fd0-e71f8ab84308 req-a0dfe7e4-6dbd-4dd2-8086-6e608fd73e98 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.483127 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-4c2862bd-623a-4cf8-8fd0-e71f8ab84308 req-a0dfe7e4-6dbd-4dd2-8086-6e608fd73e98 service nova] Creating event network-changed:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:37:06.489005 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-4c2862bd-623a-4cf8-8fd0-e71f8ab84308 req-a0dfe7e4-6dbd-4dd2-8086-6e608fd73e98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044782 Aug 27 03:37:06.493232 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 578/1197] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:06.566995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lazy-loading 'services' on Instance uuid 0813a770-efab-496a-8c4c-9e2f72102ca8 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:37:06.646112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-86b56d3f-7757-4376-b838-94e5a67a9f9e tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments/3fd4665c-291a-4f74-baf9-d98aebfccefb" status: 202 len: 0 microversion: 2.1 time: 0.206809 Aug 27 03:37:06.647527 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 620/1198] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:37:06 2021] DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments/3fd4665c-291a-4f74-baf9-d98aebfccefb => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:06.658015 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.659202 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:06.667372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.668246 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.670006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:06.670799 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:06.720149 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1091aed4-bb08-4a11-8701-5c119ab73882 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067403 Aug 27 03:37:06.720968 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 579/1199] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:37:06 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:07.732645 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.734162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:07.740994 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.741431 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.742213 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.742636 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.772523 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-85371994-4950-4fba-b77e-fd07fef4f78a tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044735 Aug 27 03:37:07.773106 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 621/1200] 10.222.0.58 () {58 vars in 1302 bytes} [Fri Aug 27 03:37:07 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:37:07.784130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.784741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:07.790651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.791086 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.791899 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:07.792329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:07.878234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] HTTP exception thrown: Instance 0813a770-efab-496a-8c4c-9e2f72102ca8 is not attached to volume 3fd4665c-291a-4f74-baf9-d98aebfccefb Aug 27 03:37:07.878992 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Returning 404 to user: Instance 0813a770-efab-496a-8c4c-9e2f72102ca8 is not attached to volume 3fd4665c-291a-4f74-baf9-d98aebfccefb {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:07.879931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a485d311-cbb9-4aa0-a076-a20ef812b673 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments/3fd4665c-291a-4f74-baf9-d98aebfccefb" status: 404 len: 154 microversion: 2.1 time: 0.100530 Aug 27 03:37:07.884080 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 580/1201] 10.222.0.58 () {58 vars in 1416 bytes} [Fri Aug 27 03:37:07 2021] DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8/os-volume_attachments/3fd4665c-291a-4f74-baf9-d98aebfccefb => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:37:09.024572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:09.025159 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:09.031342 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:09.031783 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:09.032718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:09.033193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:09.060591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:37:09.138916 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d75f1aae-d69c-4473-ba34-5de7da70f1bd tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 204 len: 0 microversion: 2.1 time: 0.118474 Aug 27 03:37:09.139849 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 622/1202] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:37:09 2021] DELETE /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:09.150623 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:09.151326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:09.157801 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:09.158315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:09.159188 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:09.159647 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:09.293141 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:09.301606 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-ddeb0c2d-60e4-435f-96a5-b82f07b0f0bf tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1554 microversion: 2.1 time: 0.156211 Aug 27 03:37:09.302169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 581/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:09 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:10.319235 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.319982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:10.325995 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:10.326430 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:10.327695 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:10.328265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:10.580144 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.588385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2be0a307-bafa-4aaf-9a02-6049df270478 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1554 microversion: 2.1 time: 0.273316 Aug 27 03:37:10.589223 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 623/1204] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:10 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:11.608198 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.609521 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:11.617844 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.618546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.619630 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:11.620264 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:11.895256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b241530f5bd4149a6dca50a1bd023e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d36ba6b374775b93c113837910ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.902937 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d08d4aac-cc22-4969-bb1d-50f9c6060879 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 200 len: 1554 microversion: 2.1 time: 0.300259 Aug 27 03:37:11.904227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 582/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:11 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 1554 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:12.038937 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-6c51d3d9-4ff0-4974-9427-0494d109bb7e req-30df2f07-a00e-4ed1-8c2c-bf9b2473acee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0813a770-efab-496a-8c4c-9e2f72102ca8", "name": "network-vif-deleted", "tag": "9bb5206b-382a-4dac-a93b-17b51b935b5a"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:12.041615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:12.041615 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:37:12.049672 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-6c51d3d9-4ff0-4974-9427-0494d109bb7e req-30df2f07-a00e-4ed1-8c2c-bf9b2473acee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.050136 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-6c51d3d9-4ff0-4974-9427-0494d109bb7e req-30df2f07-a00e-4ed1-8c2c-bf9b2473acee service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.062089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-6c51d3d9-4ff0-4974-9427-0494d109bb7e req-30df2f07-a00e-4ed1-8c2c-bf9b2473acee service nova] Creating event network-vif-deleted:9bb5206b-382a-4dac-a93b-17b51b935b5a for instance 0813a770-efab-496a-8c4c-9e2f72102ca8 on hv-cinder-80473 Aug 27 03:37:12.067528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-6c51d3d9-4ff0-4974-9427-0494d109bb7e req-30df2f07-a00e-4ed1-8c2c-bf9b2473acee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Aug 27 03:37:12.068071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 624/1206] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:12.920045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.920653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] [instance: 0813a770-efab-496a-8c4c-9e2f72102ca8] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:12.927363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.927825 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.928588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:12.929137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:12.943833 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] HTTP exception thrown: Instance 0813a770-efab-496a-8c4c-9e2f72102ca8 could not be found. Aug 27 03:37:12.944785 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Returning 404 to user: Instance 0813a770-efab-496a-8c4c-9e2f72102ca8 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:12.945855 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5c63e6c6-9380-47c1-a963-f0640d14dd56 tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8" status: 404 len: 111 microversion: 2.1 time: 0.029444 Aug 27 03:37:12.950162 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 583/1207] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:12 2021] GET /compute/v2.1/servers/0813a770-efab-496a-8c4c-9e2f72102ca8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:12.955750 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ef143212-75a2-4636-a8a7-4737b77575ff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] Calling method '.version_select at 0x7f6d008965e0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.982279 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ef143212-75a2-4636-a8a7-4737b77575ff tempest-TestMinimumBasicScenario-39683287 tempest-TestMinimumBasicScenario-39683287-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-638811788" status: 202 len: 0 microversion: 2.1 time: 0.030610 Aug 27 03:37:12.983664 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 625/1208] 10.222.0.58 () {58 vars in 1269 bytes} [Fri Aug 27 03:37:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-638811788 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:37:17.826109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-680150234", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "983f4440-cdf8-47c6-92ca-6c53c209742b"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:17.890412 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] validate_networks() for [('983f4440-cdf8-47c6-92ca-6c53c209742b', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:37:18.577277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:18.577653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:18.578319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:18.578717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:18.579083 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:18.589151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.589874 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.590904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:18.591546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:18.610344 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Getting quotas for project 87c503a5f4c94ed5a5d883191cf39692. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:37:18.615109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Getting quotas for user aadbda5d4102494897e11f6818d4ca4a and project 87c503a5f4c94ed5a5d883191cf39692. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:37:18.626715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:37:18.629098 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:37:18.678743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d3af68ec-1ebf-487b-9e64-1ac8aa8bf565 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856263 Aug 27 03:37:18.679942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 584/1209] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:37:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:37:18.690010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-66893d41-3094-4b10-b37d-2e2fd663fcf9 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.690778 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-66893d41-3094-4b10-b37d-2e2fd663fcf9 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:18.757371 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-66893d41-3094-4b10-b37d-2e2fd663fcf9 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.764773 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-66893d41-3094-4b10-b37d-2e2fd663fcf9 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1213 microversion: 2.1 time: 0.079057 Aug 27 03:37:18.765473 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 626/1210] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:18 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:19.781656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:19.782642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:19.788967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.789408 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.790360 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:19.790792 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:19.935258 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:19.943714 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2fd9e717-e076-4fbb-a1a7-dba736aa27bc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1271 microversion: 2.1 time: 0.165751 Aug 27 03:37:19.944296 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 585/1211] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:19 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.961193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:20.961815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:20.969605 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:20.970089 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:20.970851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:20.971283 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.342901 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.350522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6d8d9caf-37d3-450c-9842-b8c555ee44a8 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.393189 Aug 27 03:37:21.351082 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 627/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:20 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:21.657957 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-6a1aa9b0-bfb9-41db-93c9-0e6819d3f129 req-3dc774c0-2de5-484e-b00c-0d2d15cce67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682cf62c-f47b-4302-a140-6ee05fa7dc23", "tag": "e1528aa4-d9b1-4a96-aea9-b2580c95e64e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:21.659601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:21.659601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:21.668094 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6a1aa9b0-bfb9-41db-93c9-0e6819d3f129 req-3dc774c0-2de5-484e-b00c-0d2d15cce67b service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:21.668862 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6a1aa9b0-bfb9-41db-93c9-0e6819d3f129 req-3dc774c0-2de5-484e-b00c-0d2d15cce67b service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:21.691482 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-6a1aa9b0-bfb9-41db-93c9-0e6819d3f129 req-3dc774c0-2de5-484e-b00c-0d2d15cce67b service nova] Creating event network-changed:e1528aa4-d9b1-4a96-aea9-b2580c95e64e for instance 682cf62c-f47b-4302-a140-6ee05fa7dc23 on hv-cinder-80473 Aug 27 03:37:21.696644 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-6a1aa9b0-bfb9-41db-93c9-0e6819d3f129 req-3dc774c0-2de5-484e-b00c-0d2d15cce67b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Aug 27 03:37:21.697317 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 586/1213] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:22.367024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.375057 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:22.383739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.384178 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.384959 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:22.385386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:22.619374 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.627256 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3f303bca-0e4b-4a71-a244-87eb71c54bcc tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.263964 Aug 27 03:37:22.627949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 628/1214] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:22 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:23.644585 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:23.645268 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:23.651915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:23.652281 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:23.653031 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:23.653449 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:23.798135 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:23.809837 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-36084449-25f7-4b08-9788-4de80e17839d tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.168900 Aug 27 03:37:23.810580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 587/1215] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:23 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:24.829805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:24.830733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:24.837485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:24.838001 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:24.838880 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:24.839402 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:24.973550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:24.981587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e0454bba-d5bd-4e38-a8f7-5ea81dbb507b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.157229 Aug 27 03:37:24.982172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 629/1216] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:24 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:26.000474 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:26.001105 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:26.007410 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:26.007841 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:26.008632 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:26.009040 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:26.157179 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:26.164955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-14fbde66-0b04-47a6-a550-44afb3330e27 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.169618 Aug 27 03:37:26.165526 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 588/1217] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:25 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:26.370255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-529701eb-a111-4355-8c57-102bcc60f93e req-e67e1fcc-5697-4026-aa3d-f10ca1302588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682cf62c-f47b-4302-a140-6ee05fa7dc23", "name": "network-vif-plugged", "status": "completed", "tag": "e1528aa4-d9b1-4a96-aea9-b2580c95e64e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:26.372469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:26.372469 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:37:26.380391 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-529701eb-a111-4355-8c57-102bcc60f93e req-e67e1fcc-5697-4026-aa3d-f10ca1302588 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:26.380831 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-529701eb-a111-4355-8c57-102bcc60f93e req-e67e1fcc-5697-4026-aa3d-f10ca1302588 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:26.392173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-529701eb-a111-4355-8c57-102bcc60f93e req-e67e1fcc-5697-4026-aa3d-f10ca1302588 service nova] Creating event network-vif-plugged:e1528aa4-d9b1-4a96-aea9-b2580c95e64e for instance 682cf62c-f47b-4302-a140-6ee05fa7dc23 on hv-cinder-80473 Aug 27 03:37:26.397375 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-529701eb-a111-4355-8c57-102bcc60f93e req-e67e1fcc-5697-4026-aa3d-f10ca1302588 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030758 Aug 27 03:37:26.398188 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 630/1218] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:27.185808 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:27.186814 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:27.197681 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:27.198426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:27.199739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:27.200448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:27.327995 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:27.335921 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a40bc098-6213-4a4d-9a89-29535163c388 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1313 microversion: 2.1 time: 0.156421 Aug 27 03:37:27.336478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 589/1219] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:27 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:28.354262 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:28.354982 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:28.362305 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.362742 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.363543 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.363957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.503341 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:28.511068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-da203e15-d1e7-4dd5-8ec5-003fcd11b6cb tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1498 microversion: 2.1 time: 0.161072 Aug 27 03:37:28.511737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 631/1220] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:28 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:28.956849 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:28.957674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:28.967019 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.967651 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.968873 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:28.969539 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:28.997489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:37:29.083981 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-19f91266-cd25-4712-8823-d32cfc3eb621 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 204 len: 0 microversion: 2.1 time: 0.134161 Aug 27 03:37:29.084577 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 590/1221] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:37:28 2021] DELETE /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:29.093142 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:29.093762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:29.100143 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:29.100587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:29.101365 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:29.101792 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:29.247965 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:29.255984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c4cf791c-b1b3-49bf-9158-a722e0b73b56 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1504 microversion: 2.1 time: 0.166683 Aug 27 03:37:29.256566 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 632/1222] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:29 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:30.278696 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:30.279930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:30.287271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:30.287739 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:30.288494 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:30.288912 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:30.425920 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:30.433860 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e5fdd1d5-94c3-4473-ac6a-1e173ab78cb6 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1504 microversion: 2.1 time: 0.161882 Aug 27 03:37:30.434430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 591/1223] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:30 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:31.268628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-64a2680a-2719-4f2a-8b66-20f268ac349a req-224c70ca-c6c6-40d6-9beb-882b8e1b014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682cf62c-f47b-4302-a140-6ee05fa7dc23", "name": "network-vif-deleted", "tag": "e1528aa4-d9b1-4a96-aea9-b2580c95e64e"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:31.270510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:31.270510 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:37:31.280591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-64a2680a-2719-4f2a-8b66-20f268ac349a req-224c70ca-c6c6-40d6-9beb-882b8e1b014c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.281161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-64a2680a-2719-4f2a-8b66-20f268ac349a req-224c70ca-c6c6-40d6-9beb-882b8e1b014c service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.293445 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-64a2680a-2719-4f2a-8b66-20f268ac349a req-224c70ca-c6c6-40d6-9beb-882b8e1b014c service nova] Creating event network-vif-deleted:e1528aa4-d9b1-4a96-aea9-b2580c95e64e for instance 682cf62c-f47b-4302-a140-6ee05fa7dc23 on hv-cinder-80473 Aug 27 03:37:31.298748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-64a2680a-2719-4f2a-8b66-20f268ac349a req-224c70ca-c6c6-40d6-9beb-882b8e1b014c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034372 Aug 27 03:37:31.299450 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 633/1224] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:31.454821 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:31.455427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:31.461635 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.462078 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.462866 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.463285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.499665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:31.500234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:31.500879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.objects.instance [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lazy-loading 'fault' on Instance uuid 682cf62c-f47b-4302-a140-6ee05fa7dc23 {{(pid=108335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:37:31.547129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:31.556025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-bbc66b7a-36a9-4668-b384-36d2ab955cd3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 200 len: 1303 microversion: 2.1 time: 0.107393 Aug 27 03:37:31.556580 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 592/1225] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:31 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:32.578053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:32.579182 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 682cf62c-f47b-4302-a140-6ee05fa7dc23] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:32.590432 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:32.591168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:32.592468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:32.593176 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:32.607962 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] HTTP exception thrown: Instance 682cf62c-f47b-4302-a140-6ee05fa7dc23 could not be found. Aug 27 03:37:32.608549 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Returning 404 to user: Instance 682cf62c-f47b-4302-a140-6ee05fa7dc23 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:32.609367 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-8539a16c-3e76-4f4e-ae4e-0c46e63c991e tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23" status: 404 len: 111 microversion: 2.1 time: 0.038167 Aug 27 03:37:32.609903 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 634/1226] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:32 2021] GET /compute/v2.1/servers/682cf62c-f47b-4302-a140-6ee05fa7dc23 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:32.719131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-747228975", "imageRef": "343e6db9-a389-49c3-9c31-438a4c50dca9", "flavorRef": "452", "networks": [{"uuid": "983f4440-cdf8-47c6-92ca-6c53c209742b"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:32.777405 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] validate_networks() for [('983f4440-cdf8-47c6-92ca-6c53c209742b', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:37:33.137554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:33.137967 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:33.138431 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:33.138814 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:33.139235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:33.150329 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:33.150922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:33.152095 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:33.152657 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:33.177931 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Getting quotas for project 87c503a5f4c94ed5a5d883191cf39692. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:37:33.181955 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Getting quotas for user aadbda5d4102494897e11f6818d4ca4a and project 87c503a5f4c94ed5a5d883191cf39692. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:37:33.193911 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:37:33.196239 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='343e6db9-a389-49c3-9c31-438a4c50dca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:37:33.250052 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5f6ab26e-1bad-41e4-ad39-1e38e1182c69 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536612 Aug 27 03:37:33.250770 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 593/1227] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:37:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:37:33.261446 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-07d3e0b9-b654-444b-ba0d-6a3008137efd tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:33.262039 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-07d3e0b9-b654-444b-ba0d-6a3008137efd tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:33.315386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-07d3e0b9-b654-444b-ba0d-6a3008137efd tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:33.322301 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-07d3e0b9-b654-444b-ba0d-6a3008137efd tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1213 microversion: 2.1 time: 0.064498 Aug 27 03:37:33.322800 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 635/1228] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:33 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:34.339277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:34.339917 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:34.346346 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:34.346897 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:34.347771 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:34.348204 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:34.414132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:34.421566 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-22094409-44e3-49a1-b5ac-7599f319c91c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1271 microversion: 2.1 time: 0.086068 Aug 27 03:37:34.422124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 594/1229] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:34 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:35.438681 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.439312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:35.445336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:35.445770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:35.446536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:35.446954 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:35.614970 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-f8c4daf8-ed30-4a80-b1de-1f3eb280340d req-1ff47a71-1fdf-41b2-ae2c-7700ef482039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de7584f-701b-4982-b3e0-71c9224d77f7", "tag": "d41a02c6-a731-464c-a5fa-65fa66155d0f"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:35.616881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:35.616881 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:35.624161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f8c4daf8-ed30-4a80-b1de-1f3eb280340d req-1ff47a71-1fdf-41b2-ae2c-7700ef482039 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:35.624588 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f8c4daf8-ed30-4a80-b1de-1f3eb280340d req-1ff47a71-1fdf-41b2-ae2c-7700ef482039 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:35.636318 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-f8c4daf8-ed30-4a80-b1de-1f3eb280340d req-1ff47a71-1fdf-41b2-ae2c-7700ef482039 service nova] Creating event network-changed:d41a02c6-a731-464c-a5fa-65fa66155d0f for instance 1de7584f-701b-4982-b3e0-71c9224d77f7 on hv-cinder-80473 Aug 27 03:37:35.641277 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-f8c4daf8-ed30-4a80-b1de-1f3eb280340d req-1ff47a71-1fdf-41b2-ae2c-7700ef482039 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030391 Aug 27 03:37:35.642042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 595/1230] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:35.699454 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:35.709251 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1fad452d-930d-4350-bbc5-543066613fb2 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.273881 Aug 27 03:37:35.710100 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 636/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:35 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:36.734197 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:36.735129 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:36.743072 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:36.743554 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:36.744363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:36.744783 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:36.893744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:36.901996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-18c35442-499a-4f57-a325-7f901a03783a tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.173795 Aug 27 03:37:36.902562 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 596/1232] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:36 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:37.922591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:37.923214 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:37.930572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.931099 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:37.931913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:37.932357 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:38.060058 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:38.067287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7dcd9736-826e-4b4e-95b7-b528f5d689b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.148661 Aug 27 03:37:38.068027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 637/1233] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:37 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:39.094956 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.095937 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:39.106840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.107617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:39.108868 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:39.109564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:39.233654 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:39.241056 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d335e9a5-a8d3-439b-a014-428251b4bb6f tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.152681 Aug 27 03:37:39.241622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 597/1234] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:39 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:40.258741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:40.258741 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:40.264913 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:40.265462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:40.266304 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:40.266774 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:40.396850 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:40.404788 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e642caf0-0bc2-4cc4-b13a-a052d1406b4c tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.150922 Aug 27 03:37:40.405584 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 638/1235] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:40 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:40.427698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-35311666-f778-4b19-866e-8117c0171275 req-48eaef5e-112a-44b9-9bc2-cc329309bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de7584f-701b-4982-b3e0-71c9224d77f7", "name": "network-vif-plugged", "status": "completed", "tag": "d41a02c6-a731-464c-a5fa-65fa66155d0f"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:40.429404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:40.429404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:40.437045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-35311666-f778-4b19-866e-8117c0171275 req-48eaef5e-112a-44b9-9bc2-cc329309bf78 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:40.437546 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-35311666-f778-4b19-866e-8117c0171275 req-48eaef5e-112a-44b9-9bc2-cc329309bf78 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:40.449846 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-35311666-f778-4b19-866e-8117c0171275 req-48eaef5e-112a-44b9-9bc2-cc329309bf78 service nova] Creating event network-vif-plugged:d41a02c6-a731-464c-a5fa-65fa66155d0f for instance 1de7584f-701b-4982-b3e0-71c9224d77f7 on hv-cinder-80473 Aug 27 03:37:40.455037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-35311666-f778-4b19-866e-8117c0171275 req-48eaef5e-112a-44b9-9bc2-cc329309bf78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Aug 27 03:37:40.455847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 598/1236] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:41.424957 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:41.425949 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:41.435056 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:41.435696 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:41.436770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:41.437325 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:41.563221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:41.571221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e68187a4-a81b-4ed0-b95d-606fe95b4523 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1313 microversion: 2.1 time: 0.152266 Aug 27 03:37:41.571828 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 639/1237] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:41 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:42.593134 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:42.594118 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:42.605029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.605757 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.607012 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:42.607772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:42.741915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:42.749315 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-22ae9003-3274-495b-96ee-43bc7eb13dd1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1498 microversion: 2.1 time: 0.163137 Aug 27 03:37:42.749891 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 599/1238] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:42 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:43.228466 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:43.229003 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:43.234934 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.235382 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.236161 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.236582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.261660 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:37:43.344112 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-84c73bf0-53e8-432f-a293-2ae5e1a165b1 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 204 len: 0 microversion: 2.1 time: 0.119148 Aug 27 03:37:43.344756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 640/1239] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:37:43 2021] DELETE /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:43.354952 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:43.355900 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:43.364968 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.366066 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.366856 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:43.367291 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:43.495671 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:43.507374 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-648d8e17-3675-4f62-b97f-d5eafcf66062 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1504 microversion: 2.1 time: 0.157322 Aug 27 03:37:43.508245 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 600/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:43 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:44.534706 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.535924 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:44.543182 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.543655 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.544420 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:44.544873 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:44.680821 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:44.688905 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-feadb6a9-0ae1-4e4c-b93d-ed8dec9b12a3 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1504 microversion: 2.1 time: 0.161085 Aug 27 03:37:44.689482 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 641/1241] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:44 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:45.271029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-2167f1b4-f800-4645-9834-63f0f53f4566 req-1846bb9f-65d5-4ee8-9689-62cb15162745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de7584f-701b-4982-b3e0-71c9224d77f7", "name": "network-vif-deleted", "tag": "d41a02c6-a731-464c-a5fa-65fa66155d0f"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:45.273126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:37:45.273126 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:37:45.282884 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2167f1b4-f800-4645-9834-63f0f53f4566 req-1846bb9f-65d5-4ee8-9689-62cb15162745 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.288138 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-2167f1b4-f800-4645-9834-63f0f53f4566 req-1846bb9f-65d5-4ee8-9689-62cb15162745 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.301721 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-2167f1b4-f800-4645-9834-63f0f53f4566 req-1846bb9f-65d5-4ee8-9689-62cb15162745 service nova] Creating event network-vif-deleted:d41a02c6-a731-464c-a5fa-65fa66155d0f for instance 1de7584f-701b-4982-b3e0-71c9224d77f7 on hv-cinder-80473 Aug 27 03:37:45.309170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-2167f1b4-f800-4645-9834-63f0f53f4566 req-1846bb9f-65d5-4ee8-9689-62cb15162745 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043204 Aug 27 03:37:45.309773 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 601/1242] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:37:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:45.713513 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:45.714345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:45.721433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.722129 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.723255 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.723815 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.758028 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:45.758460 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:45.758907 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lazy-loading 'fault' on Instance uuid 1de7584f-701b-4982-b3e0-71c9224d77f7 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:37:45.806770 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadbda5d4102494897e11f6818d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c503a5f4c94ed5a5d883191cf39692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:45.813640 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5bacc014-d6d8-4f0f-bdfa-3aa6323ee442 tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 200 len: 1303 microversion: 2.1 time: 0.110647 Aug 27 03:37:45.814198 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 642/1243] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:45 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:46.838061 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:46.839193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] [instance: 1de7584f-701b-4982-b3e0-71c9224d77f7] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:37:46.850353 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:46.850809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:46.851616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:37:46.852049 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:37:46.865551 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] HTTP exception thrown: Instance 1de7584f-701b-4982-b3e0-71c9224d77f7 could not be found. Aug 27 03:37:46.866363 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] Returning 404 to user: Instance 1de7584f-701b-4982-b3e0-71c9224d77f7 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:37:46.867183 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-6997edd7-392f-47bf-9991-2023f10c112b tempest-VolumesActionsTest-1602434986 tempest-VolumesActionsTest-1602434986-project] 10.222.0.58 "GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7" status: 404 len: 111 microversion: 2.1 time: 0.036635 Aug 27 03:37:46.867778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 602/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:37:46 2021] GET /compute/v2.1/servers/1de7584f-701b-4982-b3e0-71c9224d77f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:22.424892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:39:22.425649 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:39:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:39:44.562917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:39:44.563851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:39:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:40:58.182633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:40:58.183892 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:40:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:42:37.708267 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:42:37.708918 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:42:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:42:42.444221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:42:42.445186 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:42:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:42:43.127909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:42:43.128752 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:42:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:43:04.592439 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:04.593226 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:43:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:43:04.708499 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:04.709427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:43:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:44:02.870467 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:03.111722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Action: 'create', calling method: .version_select at 0x7f6cfc272820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-207794064"}} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:03.130253 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:44:03.134458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for user a051500af0e74e6381541d68ac0db85e and project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:44:03.236851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:44:03.240805 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.quota [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for user a051500af0e74e6381541d68ac0db85e and project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'key_pairs'} {{(pid=108336) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:44:03.254716 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-02ac70fb-84dd-4b70-acb8-847476d46dd0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.386113 Aug 27 03:44:03.255267 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 643/1245] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Aug 27 03:44:02 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:18.207107 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:44:18.207809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:44:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:44:20.832980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4e4f45c-9292-4397-83b9-8a7454cfdbf6] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:20.836724 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-353015397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-207794064", "security_groups": [{"name": "tempest-secgroup-smoke-733916558"}], "block_device_mapping_v2": [{"uuid": "8671ec78-887c-44f8-934d-3ea25972ed34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ab7433b-1716-421d-bc0a-cb67ae511239"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:21.090574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] validate_networks() for [('9ab7433b-1716-421d-bc0a-cb67ae511239', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:44:21.606298 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:44:21.606903 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:44:21.607713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:44:21.608323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:44:21.608926 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:44:21.619988 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:21.620418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:21.621211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:21.621615 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:21.639372 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:44:21.644097 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for user a051500af0e74e6381541d68ac0db85e and project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:44:21.706133 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:44:21.708401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8671ec78-887c-44f8-934d-3ea25972ed34',volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:44:21.850155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-677d8e0d-5f65-47d4-84c8-c4a37dcb9f3b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019404 Aug 27 03:44:21.851130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 603/1246] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:44:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:44:21.871172 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-b30f1ecf-69c8-4275-9b04-09d2ef68da04 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:21.872061 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-b30f1ecf-69c8-4275-9b04-09d2ef68da04 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:21.885587 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55956. Aug 27 03:44:21.980535 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-b30f1ecf-69c8-4275-9b04-09d2ef68da04 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:21.987097 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-b30f1ecf-69c8-4275-9b04-09d2ef68da04 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1093 microversion: 2.1 time: 0.130074 Aug 27 03:44:21.987713 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 644/1247] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:21 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1093 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:23.004587 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:23.005194 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:23.012250 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:23.012689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:23.013457 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:23.014053 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:23.019890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4e4f45c-9292-4397-83b9-8a7454cfdbf6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55952. Aug 27 03:44:23.087497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:23.095638 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7ef51041-1e02-4a0d-aa71-2ea7dbc092d2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1209 microversion: 2.1 time: 0.095284 Aug 27 03:44:23.096038 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 604/1248] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:22 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.113867 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.114520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:24.124140 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:24.124647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:24.125395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:24.126042 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:24.347229 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.358616 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-1cc40243-6bc7-43eb-bbf5-4ee09fbd94aa tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.248776 Aug 27 03:44:24.359181 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 645/1249] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:24 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.551625 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-b24a2a6a-d9fb-4fac-b4fe-e1fdfb482481 req-5d85df06-96d9-46c9-8286-acce14100c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750ab0df-18d4-40ff-bd93-a92231f88a29", "tag": "c08d2ca0-dce8-40f9-a633-9f83a36aa1f9"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:24.553251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:24.553251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:44:24.560522 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b24a2a6a-d9fb-4fac-b4fe-e1fdfb482481 req-5d85df06-96d9-46c9-8286-acce14100c80 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:24.560743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-b24a2a6a-d9fb-4fac-b4fe-e1fdfb482481 req-5d85df06-96d9-46c9-8286-acce14100c80 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:24.572614 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-b24a2a6a-d9fb-4fac-b4fe-e1fdfb482481 req-5d85df06-96d9-46c9-8286-acce14100c80 service nova] Creating event network-changed:c08d2ca0-dce8-40f9-a633-9f83a36aa1f9 for instance 750ab0df-18d4-40ff-bd93-a92231f88a29 on hv-cinder-80473 Aug 27 03:44:24.578883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-b24a2a6a-d9fb-4fac-b4fe-e1fdfb482481 req-5d85df06-96d9-46c9-8286-acce14100c80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100946 Aug 27 03:44:24.579922 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 605/1250] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:44:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:25.377458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:25.378062 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:25.385468 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:25.385910 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:25.386678 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:25.387102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:25.563975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:25.573308 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d62b9e0f-f0d8-4378-abb6-2f35f84c4618 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.200014 Aug 27 03:44:25.573894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 646/1251] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:25 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:26.595876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:26.597026 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:26.604218 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:26.604661 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:26.605424 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:26.605848 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:26.742085 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:26.752670 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-2776658f-b5fd-47c0-a814-b73b058908a2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.163346 Aug 27 03:44:26.753460 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 606/1252] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:26 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:27.770168 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:27.771025 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:27.777552 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:27.777993 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:27.778753 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:27.779175 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:27.913091 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:27.921193 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-21c4c730-0640-4d27-9280-ddcf556152bf tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.155096 Aug 27 03:44:27.921748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 647/1253] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:27 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:28.942750 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:28.944029 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:28.954418 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:28.955131 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:28.956480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:28.957190 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:29.096265 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:29.108124 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-8d1d50ea-1f9e-4259-8b2a-d11f506e62c8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.171627 Aug 27 03:44:29.108977 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 607/1254] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:28 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:30.131120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:30.131884 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:30.139895 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:30.140449 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:30.141419 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:30.141938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:30.280739 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:30.289807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-45aaa584-0cee-4bfb-b229-883dc864f2b7 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.164962 Aug 27 03:44:30.290395 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 648/1255] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:30 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:31.311169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:31.312170 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:31.322990 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:31.323777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:31.325006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:31.325694 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:31.462325 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:31.470406 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cae93f64-1e63-455a-9e7c-afe28f5775b5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.165541 Aug 27 03:44:31.470942 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 608/1256] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:31 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.489096 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.490809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:32.497113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:32.497628 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:32.498416 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:32.498865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:32.623512 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.635005 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6fabf1bc-401c-4636-b1f2-385c86fd7b05 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.149450 Aug 27 03:44:32.635958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 649/1257] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:32 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:33.660343 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:33.662221 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:33.672478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:33.673215 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:33.674468 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:33.675193 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:33.811184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:33.819284 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-87173b22-515a-4b8e-b9cf-adba5db14e75 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.165477 Aug 27 03:44:33.819876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 609/1258] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:33 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:34.125984 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-c2da6943-b407-44ce-95fb-0482df167f57 req-81c20bcc-4244-43d4-9281-8fcc8377d68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750ab0df-18d4-40ff-bd93-a92231f88a29", "name": "network-vif-plugged", "status": "completed", "tag": "c08d2ca0-dce8-40f9-a633-9f83a36aa1f9"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:34.127522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:34.127522 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:44:34.134295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-c2da6943-b407-44ce-95fb-0482df167f57 req-81c20bcc-4244-43d4-9281-8fcc8377d68e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:34.137443 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-c2da6943-b407-44ce-95fb-0482df167f57 req-81c20bcc-4244-43d4-9281-8fcc8377d68e service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:34.149053 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-c2da6943-b407-44ce-95fb-0482df167f57 req-81c20bcc-4244-43d4-9281-8fcc8377d68e service nova] Creating event network-vif-plugged:c08d2ca0-dce8-40f9-a633-9f83a36aa1f9 for instance 750ab0df-18d4-40ff-bd93-a92231f88a29 on hv-cinder-80473 Aug 27 03:44:34.155287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-c2da6943-b407-44ce-95fb-0482df167f57 req-81c20bcc-4244-43d4-9281-8fcc8377d68e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091381 Aug 27 03:44:34.155923 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 650/1259] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:44:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:44:34.838430 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:34.839210 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:34.847567 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:34.848184 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:34.849235 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:34.850024 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:34.981039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:34.989050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-492e0d50-3c03-42eb-8da4-158b44b65a15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1264 microversion: 2.1 time: 0.155940 Aug 27 03:44:34.989698 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 610/1260] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:34 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:36.011767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:36.012902 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:36.023772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:36.024486 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:36.025733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:36.026433 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:36.171869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:36.180201 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-fc20d72c-415b-4ad2-ab9d-5edc394aa64a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1450 microversion: 2.1 time: 0.175890 Aug 27 03:44:36.180771 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 651/1261] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:36 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:36.196566 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:36.197153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:44:36.203255 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:36.203744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:36.204534 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:36.205025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:36.335701 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:36.347779 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-17074e36-f3e0-4bd5-98d8-aad30d6615ba tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1450 microversion: 2.1 time: 0.154921 Aug 27 03:44:36.348523 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 611/1262] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:44:36 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:38.216227 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-2822222c-4f50-499b-aae5-6f2472289652 req-2d7a8003-2ebe-455f-82d9-78e133fa25d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750ab0df-18d4-40ff-bd93-a92231f88a29", "tag": "c08d2ca0-dce8-40f9-a633-9f83a36aa1f9"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:38.217732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:38.217732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:44:38.224684 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-2822222c-4f50-499b-aae5-6f2472289652 req-2d7a8003-2ebe-455f-82d9-78e133fa25d6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:44:38.225233 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-2822222c-4f50-499b-aae5-6f2472289652 req-2d7a8003-2ebe-455f-82d9-78e133fa25d6 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:44:38.238891 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-2822222c-4f50-499b-aae5-6f2472289652 req-2d7a8003-2ebe-455f-82d9-78e133fa25d6 service nova] Creating event network-changed:c08d2ca0-dce8-40f9-a633-9f83a36aa1f9 for instance 750ab0df-18d4-40ff-bd93-a92231f88a29 on hv-cinder-80473 Aug 27 03:44:38.244857 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-2822222c-4f50-499b-aae5-6f2472289652 req-2d7a8003-2ebe-455f-82d9-78e133fa25d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088361 Aug 27 03:44:38.245550 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 652/1263] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:44:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:02.473153 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:46:02.473991 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:46:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:46:35.375919 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:35.377063 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:35.383646 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:35.384109 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:35.384907 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:35.385334 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:35.412322 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Going to try to terminate instance {{(pid=108335) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:46:35.495601 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-3acb4133-0fae-4b60-80c4-76aaef1164ea tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "DELETE /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 204 len: 0 microversion: 2.1 time: 0.127175 Aug 27 03:46:35.496211 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 612/1264] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:46:35 2021] DELETE /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:35.503936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 03:46:35.507887 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:35.508572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:35.514999 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:35.515476 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:35.516238 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:35.516667 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:35.652589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:35.661183 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-06335b69-debe-4107-afd6-dee8e300c5a0 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1575 microversion: 2.1 time: 0.160153 Aug 27 03:46:35.661776 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 653/1265] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:35 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:36.686484 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:36.687685 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:36.695187 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:36.695667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:36.696466 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:36.696888 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:36.827569 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:36.836033 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-05cfd3fc-7c71-48c9-952b-bcc2e0614ec6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1575 microversion: 2.1 time: 0.156707 Aug 27 03:46:36.836618 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 613/1266] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:36 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:37.857951 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:37.858521 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:37.876108 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:37.876545 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:37.877762 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:37.878369 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:37.884926 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56068. Aug 27 03:46:37.945345 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:37.952816 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0ea53aea-81b1-4298-a431-6d485fb6ed15 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 200 len: 1508 microversion: 2.1 time: 0.099890 Aug 27 03:46:37.953373 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 654/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:37 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 1508 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:38.061457 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-4a252fc1-3de4-4373-afe0-4fa138a32ac5 req-69953dad-13e2-4e19-86f6-f1ff024bb2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750ab0df-18d4-40ff-bd93-a92231f88a29", "name": "network-vif-deleted", "tag": "c08d2ca0-dce8-40f9-a633-9f83a36aa1f9"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:38.063256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:46:38.063256 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:46:38.074157 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4a252fc1-3de4-4373-afe0-4fa138a32ac5 req-69953dad-13e2-4e19-86f6-f1ff024bb2b2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:38.074946 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-4a252fc1-3de4-4373-afe0-4fa138a32ac5 req-69953dad-13e2-4e19-86f6-f1ff024bb2b2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:38.087495 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-4a252fc1-3de4-4373-afe0-4fa138a32ac5 req-69953dad-13e2-4e19-86f6-f1ff024bb2b2 service nova] Creating event network-vif-deleted:c08d2ca0-dce8-40f9-a633-9f83a36aa1f9 for instance 750ab0df-18d4-40ff-bd93-a92231f88a29 on hv-cinder-80473 Aug 27 03:46:38.094491 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-4a252fc1-3de4-4373-afe0-4fa138a32ac5 req-69953dad-13e2-4e19-86f6-f1ff024bb2b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036728 Aug 27 03:46:38.095497 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 614/1268] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:38.969790 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:38.970538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:38.977647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:38.978087 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:38.978852 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:38.979271 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:38.993185 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] HTTP exception thrown: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. Aug 27 03:46:38.993827 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Returning 404 to user: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:46:38.994647 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f7c820d5-9929-497e-b293-73291b8479d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 404 len: 111 microversion: 2.1 time: 0.029119 Aug 27 03:46:38.995175 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 655/1269] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:38 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:39.045802 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1620388426", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-207794064", "security_groups": [{"name": "tempest-secgroup-smoke-733916558"}], "block_device_mapping_v2": [{"uuid": "8671ec78-887c-44f8-934d-3ea25972ed34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ab7433b-1716-421d-bc0a-cb67ae511239"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:39.156251 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] validate_networks() for [('9ab7433b-1716-421d-bc0a-cb67ae511239', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:46:39.540350 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:39.540766 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:39.541227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:39.541652 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:39.542051 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:39.553642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:39.554094 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:39.554879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:39.555297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:39.572195 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:46:39.576383 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for user a051500af0e74e6381541d68ac0db85e and project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:46:39.642074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:46:39.644616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8671ec78-887c-44f8-934d-3ea25972ed34',volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:46:39.785847 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [d984dc13-0232-4f3d-982e-34cca8add00c] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:46:40.803653 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [d984dc13-0232-4f3d-982e-34cca8add00c] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56092. Aug 27 03:46:40.808068 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-cb2e9923-f7cb-4f9c-b0b7-62ecebfdd4f4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.766451 Aug 27 03:46:40.808731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 615/1270] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:46:39 2021] POST /compute/v2.1/servers => generated 405 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:40.819242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-52221487-6e3d-46f6-8ce0-a2fa0ceeb4db tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:40.819842 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-52221487-6e3d-46f6-8ce0-a2fa0ceeb4db tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:40.875074 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-52221487-6e3d-46f6-8ce0-a2fa0ceeb4db tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:40.886969 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-52221487-6e3d-46f6-8ce0-a2fa0ceeb4db tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1094 microversion: 2.1 time: 0.071450 Aug 27 03:46:40.887838 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 656/1271] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:40 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:41.906159 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-0fc8345e-5c68-481a-864c-78ef3f85205e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:41.906711 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-0fc8345e-5c68-481a-864c-78ef3f85205e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:41.960933 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-0fc8345e-5c68-481a-864c-78ef3f85205e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:41.971574 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-0fc8345e-5c68-481a-864c-78ef3f85205e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1094 microversion: 2.1 time: 0.068952 Aug 27 03:46:41.972437 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 616/1272] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:41 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:42.993029 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c2bb557b-d8d3-4e1b-9d84-accc2a2c898a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:42.993621 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c2bb557b-d8d3-4e1b-9d84-accc2a2c898a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:43.046947 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c2bb557b-d8d3-4e1b-9d84-accc2a2c898a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:43.055472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c2bb557b-d8d3-4e1b-9d84-accc2a2c898a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1094 microversion: 2.1 time: 0.066226 Aug 27 03:46:43.056049 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 657/1273] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:42 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:44.073002 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-86bf38b7-9741-4335-97a7-216282e1cc58 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:44.074047 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-86bf38b7-9741-4335-97a7-216282e1cc58 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:44.130619 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-86bf38b7-9741-4335-97a7-216282e1cc58 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:44.137340 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-86bf38b7-9741-4335-97a7-216282e1cc58 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1094 microversion: 2.1 time: 0.068135 Aug 27 03:46:44.137914 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 617/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:44 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:45.159372 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:45.160539 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:45.168095 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:45.168485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:45.169259 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:45.169685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:45.232638 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:45.241241 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-0ce9b52a-7237-4bb5-ab7f-75c55f4adb97 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1144 microversion: 2.1 time: 0.088441 Aug 27 03:46:45.242030 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 658/1275] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:45 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:46.259033 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:46.260225 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:46.268224 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:46.268679 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:46.269525 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:46.270300 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:46.388074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:46.398879 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-171c64c9-1d8b-419f-ad7d-ba0231041b56 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1210 microversion: 2.1 time: 0.143831 Aug 27 03:46:46.399489 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 618/1276] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:46 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:47.293835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-ee7b42ca-bc56-4709-8791-a25725bef60c req-2b432945-3858-4990-85bb-9b619ec874f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee358442-5e68-4a40-8e63-0076f2b8a259", "tag": "1d1814d3-77e1-439b-8aba-c1723bc486fd"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:47.296280 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:46:47.296280 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:46:47.311317 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ee7b42ca-bc56-4709-8791-a25725bef60c req-2b432945-3858-4990-85bb-9b619ec874f1 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:47.312590 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-ee7b42ca-bc56-4709-8791-a25725bef60c req-2b432945-3858-4990-85bb-9b619ec874f1 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:47.326472 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-ee7b42ca-bc56-4709-8791-a25725bef60c req-2b432945-3858-4990-85bb-9b619ec874f1 service nova] Creating event network-changed:1d1814d3-77e1-439b-8aba-c1723bc486fd for instance ee358442-5e68-4a40-8e63-0076f2b8a259 on hv-cinder-80473 Aug 27 03:46:47.332997 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-ee7b42ca-bc56-4709-8791-a25725bef60c req-2b432945-3858-4990-85bb-9b619ec874f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044862 Aug 27 03:46:47.334279 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 659/1277] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:46:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:47.417656 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:47.418261 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:47.428504 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:47.429234 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:47.430042 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:47.430471 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:47.597037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:47.605845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-71866a9e-d41e-49b8-b611-4d4e9fb3e152 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.191939 Aug 27 03:46:47.606667 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 619/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:47 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:48.628442 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:48.629595 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:48.637385 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:48.637829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:48.638594 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:48.639025 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:48.769563 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:48.777470 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-ecf163e2-07e4-40eb-87ac-4b2e06282146 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.156206 Aug 27 03:46:48.778029 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 660/1279] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:48 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:49.794754 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:49.795456 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:49.802624 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:49.803074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:49.804421 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:49.804898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:49.945169 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:49.952845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-dcb628e7-df62-4b46-898f-447f1280050a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.161926 Aug 27 03:46:49.953420 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 620/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:49 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:50.971894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:50.972646 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:50.980323 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:50.980780 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:50.981547 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:50.981972 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:51.118494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:51.130295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-17d95d7c-5ea0-46df-aa55-18f425d709e2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.162894 Aug 27 03:46:51.130987 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 661/1281] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:50 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:52.151273 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:52.152148 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:52.160573 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:52.161166 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:52.162192 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:52.162778 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:52.306840 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:52.314674 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f9e40a0f-53e1-471f-b9ef-4efd44c0b970 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.169449 Aug 27 03:46:52.315259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 621/1282] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:52 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:53.335943 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:53.338173 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:53.347975 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:53.348719 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:53.349989 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:53.350707 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:53.498322 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:53.510494 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-96cc04c8-4845-4d49-b40c-c515def09b4e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.180869 Aug 27 03:46:53.511208 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 662/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:53 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:54.533744 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:54.534373 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:54.542319 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:54.542751 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:54.543564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:54.543985 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:54.674478 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:54.682876 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-83dd9770-7ce4-4b43-a34e-76c663ac05d4 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.153493 Aug 27 03:46:54.683479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 622/1284] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:54 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:55.704451 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:55.705408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:55.714634 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:55.715071 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:55.715859 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:55.716277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:55.848312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:55.859748 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4859e946-5ac9-4b64-b469-87287dc2ce11 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.161266 Aug 27 03:46:55.860665 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 663/1285] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:55 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:56.809137 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-f52a3e99-d761-407d-b48b-72fd44794f51 req-bb5c8ba6-70dc-43ff-bdc9-35e7a9201f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee358442-5e68-4a40-8e63-0076f2b8a259", "name": "network-vif-plugged", "status": "completed", "tag": "1d1814d3-77e1-439b-8aba-c1723bc486fd"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:56.810636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:46:56.810636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:46:56.817692 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f52a3e99-d761-407d-b48b-72fd44794f51 req-bb5c8ba6-70dc-43ff-bdc9-35e7a9201f21 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:56.818332 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-f52a3e99-d761-407d-b48b-72fd44794f51 req-bb5c8ba6-70dc-43ff-bdc9-35e7a9201f21 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:56.829889 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-f52a3e99-d761-407d-b48b-72fd44794f51 req-bb5c8ba6-70dc-43ff-bdc9-35e7a9201f21 service nova] Creating event network-vif-plugged:1d1814d3-77e1-439b-8aba-c1723bc486fd for instance ee358442-5e68-4a40-8e63-0076f2b8a259 on hv-cinder-80473 Aug 27 03:46:56.835310 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-f52a3e99-d761-407d-b48b-72fd44794f51 req-bb5c8ba6-70dc-43ff-bdc9-35e7a9201f21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Aug 27 03:46:56.835935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 623/1286] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:46:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:56.880120 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:56.880637 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:56.886496 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:56.886930 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:56.887682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:56.888101 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:57.009988 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:57.017528 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a10dac31-15d5-4822-a922-c913c74c98f8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.141038 Aug 27 03:46:57.018010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 664/1287] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:56 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:58.039045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:58.040279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:58.052209 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:58.052964 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:58.054259 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:58.056158 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:58.193050 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:58.202936 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-747dbb15-b2b1-4a30-84f4-9599ea5bc332 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1265 microversion: 2.1 time: 0.170732 Aug 27 03:46:58.203548 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 624/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:58 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:59.225604 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:59.226614 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:59.234278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:59.234721 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:59.235509 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:59.235932 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:59.369374 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:59.377854 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-6b544a5e-0c5f-4a9d-afb6-bb5284144859 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1451 microversion: 2.1 time: 0.158333 Aug 27 03:46:59.378424 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 665/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:59 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:59.394125 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:59.394710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:46:59.400873 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:59.401313 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:59.402168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:46:59.402743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:46:59.555145 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:59.564032 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-88983504-5676-4033-8d23-b5d60d5f8ad2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1451 microversion: 2.1 time: 0.173592 Aug 27 03:46:59.564609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 625/1290] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:46:59 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:01.496967 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [req-e3816594-efad-4b46-b0ea-a3f6f3493436 req-2f3c1b7c-17af-4eed-9d9f-92a2fb0006b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee358442-5e68-4a40-8e63-0076f2b8a259", "tag": "1d1814d3-77e1-439b-8aba-c1723bc486fd"}]} {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:01.498440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:47:01.498440 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: warnings.warn(msg) Aug 27 03:47:01.506483 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e3816594-efad-4b46-b0ea-a3f6f3493436 req-2f3c1b7c-17af-4eed-9d9f-92a2fb0006b2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:47:01.506955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [req-e3816594-efad-4b46-b0ea-a3f6f3493436 req-2f3c1b7c-17af-4eed-9d9f-92a2fb0006b2 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:47:01.517864 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.compute.server_external_events [req-e3816594-efad-4b46-b0ea-a3f6f3493436 req-2f3c1b7c-17af-4eed-9d9f-92a2fb0006b2 service nova] Creating event network-changed:1d1814d3-77e1-439b-8aba-c1723bc486fd for instance ee358442-5e68-4a40-8e63-0076f2b8a259 on hv-cinder-80473 Aug 27 03:47:01.523013 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [req-e3816594-efad-4b46-b0ea-a3f6f3493436 req-2f3c1b7c-17af-4eed-9d9f-92a2fb0006b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029739 Aug 27 03:47:01.523623 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 666/1291] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:47:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:38.232289 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:47:38.233489 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:47:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:48:35.383590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4e4f45c-9292-4397-83b9-8a7454cfdbf6] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:48:35.387055 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1880388208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-207794064", "security_groups": [{"name": "tempest-secgroup-smoke-733916558"}], "block_device_mapping_v2": [{"uuid": "5b269938-dc18-47cb-814b-2da73823cc32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ab7433b-1716-421d-bc0a-cb67ae511239"}]}} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:35.502301 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.network.neutron [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] validate_networks() for [('9ab7433b-1716-421d-bc0a-cb67ae511239', None, None, None, None, None)] {{(pid=108335) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 03:48:35.937271 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:48:35.937789 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image limits 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:48:35.938297 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Flavor pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:48:35.938710 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Image pref 0:0:0 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:48:35.939112 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.virt.hardware [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:48:35.949045 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:35.949520 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:35.950323 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:35.950758 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:35.968025 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:48:35.972223 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.quota [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Getting quotas for user a051500af0e74e6381541d68ac0db85e and project 3b3caaf70e4a491c8eafa684e6f8930e. Resources: {'instances', 'ram', 'cores'} {{(pid=108335) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:48:36.034341 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Going to run 1 instances... {{(pid=108335) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 03:48:36.036689 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b269938-dc18-47cb-814b-2da73823cc32',volume_size=None,volume_type=None)] {{(pid=108335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 03:48:36.176616 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-1e6a5909-e828-44f5-b8b1-5f416f804973 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.795340 Aug 27 03:48:36.177279 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 626/1292] 10.222.0.58 () {60 vars in 1147 bytes} [Fri Aug 27 03:48:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:48:36.190278 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-5b84887b-0b74-42d7-b6c7-78e5c56c2c0a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:36.191592 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-5b84887b-0b74-42d7-b6c7-78e5c56c2c0a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:36.247330 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-5b84887b-0b74-42d7-b6c7-78e5c56c2c0a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:36.254955 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-5b84887b-0b74-42d7-b6c7-78e5c56c2c0a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1094 microversion: 2.1 time: 0.071061 Aug 27 03:48:36.255571 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 667/1293] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:36 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:37.271900 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:37.272586 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:37.295543 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4e4f45c-9292-4397-83b9-8a7454cfdbf6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56236. Aug 27 03:48:37.300708 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:37.301260 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:37.302130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:37.302626 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:37.378263 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:37.388326 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-f0fd0984-a635-47c0-97ed-02192e2fa63f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1210 microversion: 2.1 time: 0.120265 Aug 27 03:48:37.388906 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 627/1294] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:37 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:38.413124 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:38.413732 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:38.420485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:38.420925 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:38.421782 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:38.422286 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:38.645844 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:38.653767 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-82ae9927-2700-4125-a0c2-b07f370d73c3 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.244644 Aug 27 03:48:38.654335 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 668/1295] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:38 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:38.981845 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-65cb8352-4061-408d-9f8f-eca08d8fb940 req-5bd7985d-a8de-42e7-a465-6c88a69c48d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e264d9-ce69-4952-8e51-26bd309ea0c0", "tag": "8089a4df-5c9a-41ca-8d1e-ed6883f87e8e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:38.983381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:48:38.983381 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:48:38.998773 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-65cb8352-4061-408d-9f8f-eca08d8fb940 req-5bd7985d-a8de-42e7-a465-6c88a69c48d5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:38.999212 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-65cb8352-4061-408d-9f8f-eca08d8fb940 req-5bd7985d-a8de-42e7-a465-6c88a69c48d5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:39.019427 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-65cb8352-4061-408d-9f8f-eca08d8fb940 req-5bd7985d-a8de-42e7-a465-6c88a69c48d5 service nova] Creating event network-changed:8089a4df-5c9a-41ca-8d1e-ed6883f87e8e for instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 on hv-cinder-80473 Aug 27 03:48:39.025001 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-65cb8352-4061-408d-9f8f-eca08d8fb940 req-5bd7985d-a8de-42e7-a465-6c88a69c48d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046833 Aug 27 03:48:39.025643 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 628/1296] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:48:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:39.670062 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:39.670712 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:39.679027 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:39.679737 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:39.680958 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:39.681386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:39.899909 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:39.908073 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7d777370-0ddd-4028-987f-9a56d55081c2 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.241656 Aug 27 03:48:39.908591 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 669/1297] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:39 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:40.930448 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:40.931633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:40.942715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:40.943501 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:40.944755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:40.945461 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:41.069530 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:41.077074 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-d69ec687-5ca2-43cc-a0b1-9f655bf10ae6 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.154190 Aug 27 03:48:41.077641 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 629/1298] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:40 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:42.096282 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:42.096917 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:42.103722 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:42.104164 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:42.104915 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:42.105336 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:42.236936 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:42.245009 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-e5881140-57e4-4dbb-bad0-472608d6e110 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.153592 Aug 27 03:48:42.245540 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 670/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:42 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:43.265935 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:43.266564 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:43.273278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:43.273717 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:43.274479 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:43.274904 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:43.402572 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:43.410278 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-e827b724-1005-4baf-9ce2-81dc5e6946b8 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.150666 Aug 27 03:48:43.410828 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 630/1300] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:43 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:44.427974 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:44.428613 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:44.435378 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:44.435829 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:44.436589 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:44.437021 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:44.568560 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:44.576798 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-f4f1ff67-99d5-4a13-a090-e37176a9f69b tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.152880 Aug 27 03:48:44.577287 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 671/1301] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:44 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:45.594293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:45.595171 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:45.601991 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:45.602426 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:45.603174 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:45.603633 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:45.736285 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:45.748132 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-30f85331-6a8e-4884-bab0-923cdf06593e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.157638 Aug 27 03:48:45.749058 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 631/1302] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:45 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:46.768572 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.769150 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:46.775633 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:46.776104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:46.776865 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:46.777393 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:46.908224 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:46.919197 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-c8decce9-804d-4dcb-ae3f-63a7c898b0bc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.156020 Aug 27 03:48:46.920064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 672/1303] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:46 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:47.940909 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:47.941774 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:47.950168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:47.950777 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:47.951880 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:47.952467 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:48.086147 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:48.093772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c9e32c4e-2628-4325-a59e-4131955b0058 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.158612 Aug 27 03:48:48.094336 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 632/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:47 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:49.113976 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:49.114581 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:49.120639 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:49.121081 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:49.121839 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:49.122265 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:49.251485 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:49.259155 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d204ce9b-e401-4e11-b070-f1512a6bb3d1 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.149909 Aug 27 03:48:49.259745 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 673/1305] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:49 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:49.313151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-44007269-2847-4fe8-b3e4-d492f06018ca req-9bc928c5-0117-4a0c-9ecf-81df1a501432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e264d9-ce69-4952-8e51-26bd309ea0c0", "name": "network-vif-plugged", "status": "completed", "tag": "8089a4df-5c9a-41ca-8d1e-ed6883f87e8e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:49.314996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:48:49.314996 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:48:49.322622 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-44007269-2847-4fe8-b3e4-d492f06018ca req-9bc928c5-0117-4a0c-9ecf-81df1a501432 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:49.323130 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-44007269-2847-4fe8-b3e4-d492f06018ca req-9bc928c5-0117-4a0c-9ecf-81df1a501432 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:49.336987 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-44007269-2847-4fe8-b3e4-d492f06018ca req-9bc928c5-0117-4a0c-9ecf-81df1a501432 service nova] Creating event network-vif-plugged:8089a4df-5c9a-41ca-8d1e-ed6883f87e8e for instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 on hv-cinder-80473 Aug 27 03:48:49.344161 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-44007269-2847-4fe8-b3e4-d492f06018ca req-9bc928c5-0117-4a0c-9ecf-81df1a501432 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034616 Aug 27 03:48:49.344835 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 633/1306] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:50.276213 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:50.276835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:50.282900 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:50.283381 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:50.284515 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:50.284940 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:50.422574 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:50.434113 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-3cbb855a-a01d-4acc-b3cb-9745dd33f174 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1265 microversion: 2.1 time: 0.161410 Aug 27 03:48:50.434817 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 674/1307] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:50 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:51.458006 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:51.458862 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:51.467403 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.467953 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.468930 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.469470 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.614076 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:51.621809 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-882a648d-b45b-401d-a83f-6968e999314f tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1451 microversion: 2.1 time: 0.171019 Aug 27 03:48:51.622455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 634/1308] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:51 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:51.641316 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:51.642270 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:48:51.652718 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.653331 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.654576 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:51.655312 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:51.796102 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:51.809676 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-20e9fc57-2191-4410-837b-28a45396b08e tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1451 microversion: 2.1 time: 0.174171 Aug 27 03:48:51.810601 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 675/1309] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:48:51 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:53.499798 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-6147a85f-98b2-4ebf-ae6d-15625f80decf req-f4b591de-0eff-4671-a238-5f45620bbdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e264d9-ce69-4952-8e51-26bd309ea0c0", "tag": "8089a4df-5c9a-41ca-8d1e-ed6883f87e8e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:53.501396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:48:53.501396 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:48:53.509151 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6147a85f-98b2-4ebf-ae6d-15625f80decf req-f4b591de-0eff-4671-a238-5f45620bbdf5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:48:53.509590 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6147a85f-98b2-4ebf-ae6d-15625f80decf req-f4b591de-0eff-4671-a238-5f45620bbdf5 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:48:53.522227 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-6147a85f-98b2-4ebf-ae6d-15625f80decf req-f4b591de-0eff-4671-a238-5f45620bbdf5 service nova] Creating event network-changed:8089a4df-5c9a-41ca-8d1e-ed6883f87e8e for instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 on hv-cinder-80473 Aug 27 03:48:53.527480 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-6147a85f-98b2-4ebf-ae6d-15625f80decf req-f4b591de-0eff-4671-a238-5f45620bbdf5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031288 Aug 27 03:48:53.528077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 635/1310] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:22.498168 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:22.499636 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:49:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:49:23.162883 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:23.164044 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:49:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:49:44.620643 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:44.621602 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:49:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:50:26.724386 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:50:26.728299 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:26.728809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:26.735803 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.736258 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.737035 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.737464 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.765223 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:50:26.787512 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-11642b70-014e-464e-b7b2-aaf54b06e4f8 req-5b78f76f-7a8f-4e4d-8682-25b53d67bb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e264d9-ce69-4952-8e51-26bd309ea0c0", "tag": "8089a4df-5c9a-41ca-8d1e-ed6883f87e8e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:26.788979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:50:26.788979 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:50:26.796745 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-11642b70-014e-464e-b7b2-aaf54b06e4f8 req-5b78f76f-7a8f-4e4d-8682-25b53d67bb99 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.797180 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-11642b70-014e-464e-b7b2-aaf54b06e4f8 req-5b78f76f-7a8f-4e4d-8682-25b53d67bb99 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.808455 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-11642b70-014e-464e-b7b2-aaf54b06e4f8 req-5b78f76f-7a8f-4e4d-8682-25b53d67bb99 service nova] Creating event network-changed:8089a4df-5c9a-41ca-8d1e-ed6883f87e8e for instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 on hv-cinder-80473 Aug 27 03:50:26.814718 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-11642b70-014e-464e-b7b2-aaf54b06e4f8 req-5b78f76f-7a8f-4e4d-8682-25b53d67bb99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093630 Aug 27 03:50:26.815542 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 636/1311] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:26.849413 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-157484b4-88bf-43b7-a10a-7f189ab2531d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "DELETE /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 204 len: 0 microversion: 2.1 time: 0.129756 Aug 27 03:50:26.850387 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 676/1312] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:50:26 2021] DELETE /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:50:26.861337 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:26.862039 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:26.868155 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.868597 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:26.869358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:26.869980 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:27.116557 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:27.124316 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-7ec7d9c5-7836-4da0-a471-e92684e4e4f5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1576 microversion: 2.1 time: 0.268795 Aug 27 03:50:27.125191 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 637/1313] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:26 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:28.148068 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:28.149092 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:28.175277 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:28.175756 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:28.176541 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:28.176967 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:28.182343 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] [82d18f7c-4a1c-45f3-80f9-0a2400b9b546] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56326. Aug 27 03:50:28.355281 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:28.363104 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-091f76d7-a1d8-4e3a-a0f5-fc43163ee79a tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1457 microversion: 2.1 time: 0.222352 Aug 27 03:50:28.363733 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 677/1314] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:28 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1457 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:29.017079 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-75467f5e-f3ab-4a23-81ba-afb67f6a40dc req-c9289856-4478-4b9b-b65b-dbb276c66a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e264d9-ce69-4952-8e51-26bd309ea0c0", "name": "network-vif-deleted", "tag": "8089a4df-5c9a-41ca-8d1e-ed6883f87e8e"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:29.018675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:50:29.018675 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:50:29.026563 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-75467f5e-f3ab-4a23-81ba-afb67f6a40dc req-c9289856-4478-4b9b-b65b-dbb276c66a82 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.027014 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-75467f5e-f3ab-4a23-81ba-afb67f6a40dc req-c9289856-4478-4b9b-b65b-dbb276c66a82 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.038507 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-75467f5e-f3ab-4a23-81ba-afb67f6a40dc req-c9289856-4478-4b9b-b65b-dbb276c66a82 service nova] Creating event network-vif-deleted:8089a4df-5c9a-41ca-8d1e-ed6883f87e8e for instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 on hv-cinder-80473 Aug 27 03:50:29.044226 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-75467f5e-f3ab-4a23-81ba-afb67f6a40dc req-c9289856-4478-4b9b-b65b-dbb276c66a82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030734 Aug 27 03:50:29.044822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 638/1315] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:29.382894 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:29.383520 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:29.390798 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.391401 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.392257 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.392582 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.427807 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:29.428242 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:29.428717 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lazy-loading 'fault' on Instance uuid 72e264d9-ce69-4952-8e51-26bd309ea0c0 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:50:29.470531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:29.481651 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-d6aba5c3-7d22-42a4-b871-c61d6f4cdd60 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 200 len: 1230 microversion: 2.1 time: 0.104927 Aug 27 03:50:29.482458 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 678/1316] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:29 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:30.509067 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:30.510206 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 72e264d9-ce69-4952-8e51-26bd309ea0c0] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:30.520723 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:30.521293 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:30.522300 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:30.522883 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:30.542735 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] HTTP exception thrown: Instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 could not be found. Aug 27 03:50:30.543609 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Returning 404 to user: Instance 72e264d9-ce69-4952-8e51-26bd309ea0c0 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:50:30.544965 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-c8ea20f1-6320-4718-8595-715fad21089d tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0" status: 404 len: 111 microversion: 2.1 time: 0.042844 Aug 27 03:50:30.545664 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 639/1317] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:30 2021] GET /compute/v2.1/servers/72e264d9-ce69-4952-8e51-26bd309ea0c0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:33.722618 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:33.723128 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:33.729869 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.730311 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.731221 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.731685 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.757772 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Going to try to terminate instance {{(pid=108336) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 03:50:33.777892 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-0d83dceb-5c65-4cbe-879a-73ac12a36a14 req-8432d7ec-014d-484b-bd90-57071b78f116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee358442-5e68-4a40-8e63-0076f2b8a259", "tag": "1d1814d3-77e1-439b-8aba-c1723bc486fd"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:33.779404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:50:33.779404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:50:33.787065 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-0d83dceb-5c65-4cbe-879a-73ac12a36a14 req-8432d7ec-014d-484b-bd90-57071b78f116 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.787541 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-0d83dceb-5c65-4cbe-879a-73ac12a36a14 req-8432d7ec-014d-484b-bd90-57071b78f116 service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.801163 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-0d83dceb-5c65-4cbe-879a-73ac12a36a14 req-8432d7ec-014d-484b-bd90-57071b78f116 service nova] Creating event network-changed:1d1814d3-77e1-439b-8aba-c1723bc486fd for instance ee358442-5e68-4a40-8e63-0076f2b8a259 on hv-cinder-80473 Aug 27 03:50:33.806665 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-0d83dceb-5c65-4cbe-879a-73ac12a36a14 req-8432d7ec-014d-484b-bd90-57071b78f116 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085181 Aug 27 03:50:33.807634 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 640/1318] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:33.846529 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-464914f5-2633-4cb0-98bb-e93dc225bfbb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 204 len: 0 microversion: 2.1 time: 0.127170 Aug 27 03:50:33.847809 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 679/1319] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:50:33 2021] DELETE /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:50:33.863274 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:33.864422 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:33.870982 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.871822 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:33.872836 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:33.873501 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:34.109713 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.policy [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108335) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:34.117642 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-779dd9af-cc9d-4856-ac25-03dbdd3401cc tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1576 microversion: 2.1 time: 0.258582 Aug 27 03:50:34.126974 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 641/1320] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:33 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:35.137064 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:35.137662 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:35.144200 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:35.144641 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:35.145408 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:35.145835 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:35.280635 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:35.288122 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-4db3126c-bc1f-46b6-92ab-20ce733f8882 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1457 microversion: 2.1 time: 0.155253 Aug 27 03:50:35.288659 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 680/1321] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:35 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:35.910858 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [req-6130d928-b8ce-41fb-943a-76ac83b0da81 req-97ebc62a-ae38-4a95-ad1a-4234ece1d88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee358442-5e68-4a40-8e63-0076f2b8a259", "name": "network-vif-deleted", "tag": "1d1814d3-77e1-439b-8aba-c1723bc486fd"}]} {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:35.912533 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:50:35.912533 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: warnings.warn(msg) Aug 27 03:50:35.920915 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6130d928-b8ce-41fb-943a-76ac83b0da81 req-97ebc62a-ae38-4a95-ad1a-4234ece1d88f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:35.921898 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [req-6130d928-b8ce-41fb-943a-76ac83b0da81 req-97ebc62a-ae38-4a95-ad1a-4234ece1d88f service nova] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:35.933950 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.compute.server_external_events [req-6130d928-b8ce-41fb-943a-76ac83b0da81 req-97ebc62a-ae38-4a95-ad1a-4234ece1d88f service nova] Creating event network-vif-deleted:1d1814d3-77e1-439b-8aba-c1723bc486fd for instance ee358442-5e68-4a40-8e63-0076f2b8a259 on hv-cinder-80473 Aug 27 03:50:35.939852 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [req-6130d928-b8ce-41fb-943a-76ac83b0da81 req-97ebc62a-ae38-4a95-ad1a-4234ece1d88f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 Aug 27 03:50:35.940475 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 642/1322] 10.222.0.58 () {64 vars in 1318 bytes} [Fri Aug 27 03:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:36.305858 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:36.306453 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:36.313536 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:36.313976 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:36.314736 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:36.315295 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:36.348055 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:36.348474 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:36.348938 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.objects.instance [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lazy-loading 'fault' on Instance uuid ee358442-5e68-4a40-8e63-0076f2b8a259 {{(pid=108336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:50:36.388693 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.policy [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a051500af0e74e6381541d68ac0db85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3caaf70e4a491c8eafa684e6f8930e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:36.396757 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-2f1cafba-b7c8-45e6-8392-62cd6d329ae5 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 200 len: 1230 microversion: 2.1 time: 0.094675 Aug 27 03:50:36.398830 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 681/1323] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:36 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:37.414954 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:37.415703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: ee358442-5e68-4a40-8e63-0076f2b8a259] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:37.422617 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.423037 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.423871 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.424303 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.438107 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] HTTP exception thrown: Instance ee358442-5e68-4a40-8e63-0076f2b8a259 could not be found. Aug 27 03:50:37.438690 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Returning 404 to user: Instance ee358442-5e68-4a40-8e63-0076f2b8a259 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:50:37.439551 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-a3698c91-a75d-42de-b6d7-1a863c807650 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259" status: 404 len: 111 microversion: 2.1 time: 0.028916 Aug 27 03:50:37.440077 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 643/1324] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:37 2021] GET /compute/v2.1/servers/ee358442-5e68-4a40-8e63-0076f2b8a259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:37.922162 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:37.922682 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.compute.api [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108336) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:37.929024 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.929462 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.930207 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.930625 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG oslo_concurrency.lockutils [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.944010 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.wsgi [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] HTTP exception thrown: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. Aug 27 03:50:37.944578 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Returning 404 to user: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. {{(pid=108336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:50:37.945370 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-a90310ad-48ce-4085-baab-79e26e022acb tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "DELETE /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 404 len: 111 microversion: 2.1 time: 0.027160 Aug 27 03:50:37.945889 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 682/1325] 10.222.0.58 () {58 vars in 1239 bytes} [Fri Aug 27 03:50:37 2021] DELETE /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:37.954143 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '>' {{(pid=108335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:37.954743 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.compute.api [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] [instance: 750ab0df-18d4-40ff-bd93-a92231f88a29] Fetching instance by UUID {{(pid=108335) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 03:50:37.961148 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.961589 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.962358 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:50:37.962772 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG oslo_concurrency.lockutils [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Lock "4467ff74-47c5-40ba-9d11-c803109ba365" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:50:37.975827 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.wsgi [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] HTTP exception thrown: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. Aug 27 03:50:37.976404 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: DEBUG nova.api.openstack.wsgi [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Returning 404 to user: Instance 750ab0df-18d4-40ff-bd93-a92231f88a29 could not be found. {{(pid=108335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:50:37.977201 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO nova.api.openstack.requestlog [None req-5ed67f85-1dce-4a7d-802b-6473d6698363 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29" status: 404 len: 111 microversion: 2.1 time: 0.026952 Aug 27 03:50:37.977709 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: [pid: 108335|app: 0|req: 644/1326] 10.222.0.58 () {58 vars in 1236 bytes} [Fri Aug 27 03:50:37 2021] GET /compute/v2.1/servers/750ab0df-18d4-40ff-bd93-a92231f88a29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:39.308531 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: DEBUG nova.api.openstack.wsgi [None req-7bbe64a9-0c25-4cb5-b86a-eceae6c30d37 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] Calling method '.version_select at 0x7f6d008593a0>' {{(pid=108336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:39.334853 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO nova.api.openstack.requestlog [None req-7bbe64a9-0c25-4cb5-b86a-eceae6c30d37 tempest-TestVolumeBootPattern-236747552 tempest-TestVolumeBootPattern-236747552-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-207794064" status: 202 len: 0 microversion: 2.1 time: 0.030005 Aug 27 03:50:39.335532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: [pid: 108336|app: 0|req: 683/1327] 10.222.0.58 () {58 vars in 1260 bytes} [Fri Aug 27 03:50:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-207794064 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:50:57.736731 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:57.737401 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:50:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:50:58.261765 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:58.262723 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:50:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:52:42.524886 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:52:42.525741 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:52:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:53:04.650538 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:04.651532 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:53:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:53:04.744916 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:04.745755 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:53:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:54:17.756715 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:17.757890 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:54:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:54:18.291851 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:18.292703 dv-cinder-804735-2-iscsi devstack@n-api.service[108336]: Fri Aug 27 03:54:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 03:56:02.553703 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:02.554320 dv-cinder-804735-2-iscsi devstack@n-api.service[108335]: Fri Aug 27 03:56:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!